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SnMmArv 

Correlators  (multiplier-averagers)  are  analysed  and 
compared  with  detectors  (rectifier-averagers)  of  various 
power  laws  from  the  point  of  view  of  their  possible  use  In 
signal  reception  systems.  Comparison  Is  made  In  terms  of 
signal- tc-noise  ratio  for  the  ilmltlng  case  of  small  input 
signal- to~nolse  ratio  and  long  averaging  time.  Of  the  de- 
tectors, the  square-law  is  found  to  be  slightly  superior 
for  determining  the  presence  of  a small  signal  in  a noise 
background,  while  if  two  samples  of  the  signal  in  incoher- 
ent background  noises  are  available , although  the  correlator 
cannot  improve  the  signal- to-noise  ratio,  it  does  have  the 
advantage  that  no  constant  terms  independent  of  the  signal 
appear  at  its  output  The  design  of  electronic  aorrelators 
is  discussed,  and  several  oractical  circuits  are. given.  Two 
other  types  of  circuits,  similar  in  operation  to  correlators, 
but  much  simpler  to  construct,  are  also  analysed.  Both  of 
these  are  very  slightly  inferior  to  true  correlators  in  out- 
put slgnal-to-noise  ratio. 
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PBEFACE 

An  investigation  of  the  possible  application  of  corre- 
lation techniques  to  acoustic  receiving  systems  is  under 
way  at  this  Laboratoryo  In  this  first  technical  memorandum 
on  the  subject  are  presented  findings  which  pertain  especi- 
ally  to  electronic  correlators,  including  theoretical 
analysis  and  practical  circuit  design,,  Consideration  of 
applications  to  specific  acoustic  systems  will  be  reserved 
for  a subsequent  memorandum. 

This  study  of  correlation  techniques  was  suggested  by 
Professor  P,  V„  Hunt,  and  the  authors  are  greatly  indebted 
to  him  for  his  helpful  and  stimulating  guidance  of  the 
project.  The  authors  also  gratefully  acknowledge  the 
assistance  of  Professor  Harvey  Brooks,  who  demonstrated 
to  them  many  of  the  methods  of  analysis  used  herein,  and 
of  Professor  David  Middleton,  who  contributed  his  time  in 
many  helpful  discussions. 
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IHTRODUCTIOW 

There  are  many  possible  criteria  for  comparing  the  effi- 
cacy of  various  systeas  for  the  reception  of  acoustic  signals. 
Many  of  these  depend  upon  the  particular  type  of  system  being 
considered.  However,  we  have  attempted  to  keep  our  considera- 
tion general  rather  than  specific,  and  have  chosen  is  a cri- 
terion of  system  performance  the  output  signal- to- noise  ratio, 
and  in  most  cases  have  concentrated  attention  on  the  important 
case  of  very  small  Input  signal- to-nolse  ratio.  In  order  to 
evaluate  signal- to-nolse  ratios  theoretically,  we  must  make 
use  of  certain  statistical  methods  for  dealing  with  the  random 
functions  we  encounter.  While  these  methods  are  by  now  rela- 
tively well  known,  the  following  sections  will  serve  as  a 
review  of  some  of  the  basic  Ideas,  os  well  as  a definition 
of  our  notation. 

Mathematical  TmtetflS  2L  Bifid om  functions1 

A particular  example  of  a random  noise  voltage  Is,  of 
course,  an  explicit  function  of  time  and  could,  In  principle, 
be  so  represented.  However,  such  a representation  would  be 
of  no  physical  Interest,  since  each  example  of  random  noise 
Is  different  and  could  never  be  exactly  repeated.  We  must 
Instead  make  use  of  certain  average  properties  of  all  noises 
belonging  to  the  same  class,  for  example,  If  we  are  concerned 
with  the  output  of  an  electronic  noise  generator,  we  focus 
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attention  on  what  would  be  the  average  properties  of  all  the 
outputs  of  a large  number  of  identical  noise  generators.  The 
outputs  of  all  these  noise  generators  comprise  an  ensemble  of 
random  functions,*,  the  complete  ensemble  is  called  a random 
process  (as  soon  as  certain  mathematical  properties  of  the 
ensemble  are  specified  — finite  mean- square  amplitude,  for 
example).  The  description  of  the  random  process  is  then 
formulated  statistically,  and  we  can  speak,  for  example,  of 
the  probability  that  at  some  time  one  of  the  noise  voltages  v 
will  lie  between  v and  v+dv  A more  complex  probability  func- 
tion will  give  the  probability  that  at  some  time  one  of  the 
noise  voltages  will  lie  between  and  v^*dv^  and  that  at  a 
definite  time  later  the  same  noise  voltage  will  lie  between 
and  v2*dT2  random  process  can  be  completely  described 

by  a sufficiently  complex  set  of  such  probability  densities . 

From  these  usually  complicated  functions,  however,  may  be 
derived  certain  average  properties  which  are  much  more  use- 
ful in  describing  and  measuring  the  noise,  these  Include  the 
mean  value,  mean-square  value,  power  spectrum,  and  correlation 
function  For  example,  if  P(v)dv  is  the  probability  that  the 
noise  voltage  v(t)  lies  between  v and  vMv,  then  the  mean  value 
of  the  noise  is 

<v  (t)>  « 

and  its  mean- square  value  is 

oo 

<y2(t£>»  f v2P(v)dv„ 

■ CD 

Of  course  ^Jp(v) dv  * 1,  since  P(v)  is  a proper  probability  den- 
sity. In  00  the  above  examples,  the  average  values  arc  denoted 
by  angular  brackets,<>,  to  indicate  that  they  are  statistical 
averages,  computed  from  the  probability  densities  which  describe 
the  ensemble  In  most  experimental  measurements  of  random  func 
tions,  on  the  other  hand,  as  when  a d c voltmeter  is  used  to  measure 


■ 

-•  QD 


vP( v)dv , 
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the  mean  value  of  a noise  voltage,  what  is  measured  is  a time 
average  of  one  member  of  the  ensemble.  Time  averages,  which  we 
shall  indicate  by  overlines,  can  be  represented  mathematically 
as 

T 

i(t)  * fil®®  v^)dt 

and  u T 

v2(t)  * T^io  h J 

If  none  of  the  probability  distributions  which  describe  a ran- 
dom process  changes  with  time,  the  process  Is  said  to  be  stationary 
If  each  member  of  a stationary  ensemble  of  random  functions  is 
typical  of  the  ensemble  as  a whole,  that  is,  if  each  member  func- 
tion can  be  expected,  as  time  progresses,  to  go  through,  with 
the  proper  frequency,  all  the  convolutions  of  any  of  the  member 

5 

functions,  the  ensemble  is  said  to  be  eraodlc.,  An  important 
theorem,  the  ergodic  theorem,  states  that  for  an  ergodic  ensemble, 
time  and  statistical  averages  are  equal,  i e , if  v(t)  is  a mem- 
ber of  an  ergodic  ensemble, 

v(t)  - <v(t)> 

It  is  not  usually  possible  to  prove  that  a given  physical  system 
is  ergodic^  the  above  description  of  the  ergodic  property  may 
serve  as  a guide  in  deciding  whether  or  not  it  is  possible  to 
make  such  an  assumption  The  ergodic  theorem  allows  us  to  re 
place  measurements  which  in  our  mathematical  model  represent 
averages  over  many  members  of  an  (ergodic)  ensemble  with  long' 
time-average  measurements  of  one  member  of  the  ensemble.  All 
the  stationary  ensembles  with  which  we  shall  be  concerned  in 
this  memorandum  are  assumed  to  be  ergodic „ 

2M  Geuaaian  PlatllfruUgn 

It  can  be  shown  that  all  the  probability  distribution*  of 
thermal  and  shot  noise,  the  types  most  often  encountered  In 
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electronic  circuits,  are  normal  or  gaussian  distributions, J 
(These  types  of  noise  are  said  to  belong  to  a gaussian  random 
process,)  Other  fairly  common  types  of  noise  are  also  more  or 
less  accurately  described  by  the  gaussian  distributions,*  The 
gaussian  probability  density  (for  the  amplitude  of  the  voltage 
v)  is 

-v2/2 


P(v) 


1^2  HO2 


e 


(1,1) 


where  is  the  mean-square  amplitude  of  the  voltage  It  will 
be  useful  later  to  determine  the  average  of  the  fourth  power 
of  a gaussian-distrlbuted  variable! 


A. 


/Zm2 


OB 

' 00 


,-v2/2*2  dv 


C2*2)2 


4 ~u 

u*  e 


du 


- -^(str2)2  * 
yir  4 

• 3<r  - 

In  general  it  may  be  shown  that 

2m  ( 2m 

< v > - *****  0- 

2B(m)V 

and,  because  the  distribution  is  here  symmetrical 


(1,2) 


(1*3) 


♦Note,  however,  that  if  gaussian  noise  is  passed  through  a non- 
linear device,  the  output  is  no  longer  gaussian.  In  Fig,  1 are 
shown  the  probability  distributions  for  gaussian  noise,  for  the 
output  of  a multiplier  when  the  inputs  are  incoherent  gaussian 
noises,  and  for  the  output  of  a Hsquarer"  when  the  input  is  gaus 
sian  noise.  The  latter  two  are  very  definitely  non-gaussian 
For  further  examples,  see  Rice’s  papers  and  Middleton’s  paper, 
cited  in  footnotj*  1, 


GAUSSIAN  NOISE 
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Fig.  1.1  Probability  densities  for  the  amplitude  v of  a geusslan 

noise,  of  its  square,  and  of  the  product  of  two  incoherent 
gaussian  noises  of  the  same  amplitude. 


> » 0 


(1*4) 
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B&2I£l£ClAiigni  2l  fiQlgfi  YeUMtl 

There  are  several  ways  in  which  mathematical  representation* 
of  noise  voltages  may  be  written,  each  of  these  being  especially 
useful  In  different  cases,  As  we  have  noted,  a particular  examp 
of  noise  might  be  represented  by  an  explicit  function  v(t)$  how- 
ever, a complete  ensemble  must  be  represented  by  a parametric 
function  of  the  form 

v(a^  ,a2 , . . . u >t)  a 

A particular  example  is  thus  characterised  by  a particular  numer- 
ical choice  of  the  parameters  ,a2c . .. (which  may  be  Infinite  in 
number),.  The  statistical  character  of  the  noise  Is  completely 
specified  if  we  know  the  probability  density  of  the  parameters 
x,  in  general  given  by  a function 

PCala2  <IB)- 

The  x's  are  called  random  variables  and  constitute  the  statisti- 
cal parameters  of  the  ensemble* 

These  ideas  will  become  clearer  in  the  light  of  several 
Samples  We  consider  first  noise  which  is  made  up  by  the 
superposition  of  a number  of  individual  events,  each  of  which 
r.ac  the  explicit  time- functional  form  f ( t)  but  with  different 
starting  times  t^,  all  of  which  fall  inside  some  long  time  in- 
terval ?.  Then  the  noise  voltage  is  given  by1^ 


v(t)  » y v f(t-tk),.  u,m 

k-1 

A particular  choice  of  a family  of  R particular  values  of  gives 
a particular  example  of  noise*  The  t^'a  correspond  t.o  th»  *'* 
and  are  the  statistical  parameters  of  the  ensemble  The  complete 
ensemble  consists  of  an  Infinity  of  examples  like  Eq-  (l-t).  In 
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which  each  of  the  parameters  t^  takes  on  all  possible  values 
within  the  time  interval  T,  within  which  the  noise  is  specified 
by  Eq.  (1„5)*  In  the  most  usual  case  the  probability  density 


P(t 


" ^ ° ^3)  dt^  o o dt^.o  o d Wj  ~ 


dt.  . c dt. 


1 ? 


d*R 


Another  representation  which  will  be  used  frequently  is  the 
Pourier  series  representation.  Consider  an  example  of  noise  in 
the  time  interval  T.  It  may  always  be  expanded  in  a Pourier 
series : 

CD 

v(t)  Janeosu)nt  + bn  sin^t],  (1.6) 

n=0 


where  u>n  * -^£0.  if  we  omit  the  term  for  n * 0,  the  average 
noise  voltage  vanishes,  which  is  the  case  of  usual  interest. 

The  an,s  and  bn's,  infinite  in  number,  are  the  statistical  para- 
meters corresponding  to  the  a's.  In  order  to  specify  the  statis- 
tical character  of  the  noise,  we  must  know  the  probability  distri- 
butions of  the  coefficients  a , bo  In  the  case  of  gaussian  noise 
it  is  customarily  assumed  that  the  aR,  bn  obey  the  gaussian  dis- 
tribution law  (Iq.  (1.1))  and  are  statistically  independent,  so 
that  the  probability  density  function  may  be  expressed,  as  a 


products 


P(a^o  o o .a  op  t b^ . o o o b Q0 ) = 


n=l 


Applying  the  properties  of  the  gaussian  distribution  (Eqs.  1.3 
and  1.4)),  we  find 

< an>  * rn  '*  < W * °S  < anam>  * < bnV  * 


(1.7) 

Another  method  of  representing  a random  function  is  te 
assume  that  the  function  vanishes  outside  the  long  interval 
-T/2  <|t  < T/2.  It  can  then  be  written  in  Fourier  integral  form 


as 
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v(  t) 


J A(f)  ei2nft  df, 


do  8) 


where  the  complex  function  A(f)  is  the  voltage  spectrum*  Now 
hy  the  Parseval  theorem,4 


v2(t)  dt  = 


v2(t)  dt  = 


2 


df  * 


This  leads  immediately  to  a definition  of  the  intensity  spectrum* 
of  the  random  process,  for,  dividing  by  T and  going  to  the  limit 
T — m»,  and  using  the  fact  that  |A(f)|2  is  an  even  function  of  f 
(because  v(t)  is  real),  we  have 


T/2  

lim  ^ J v2(t)dt  * v2(t) 

. -T/2 

T— *<D 


W(f)df, 


where  the  intensity  spectrum  is  defined  as 


W(f) 


lim 
T — >00 


0 


In  this  representation  the  functions  A(f),  which  are  different 
for  each  member  of  the  ensemble,  take  the  place  of  the  statisti- 
cal parameters* 

Swarclattm  fundi  am 

A very  useful  method  of  expressing  the  properties  of  ran- 
dom processes  is  in  terms  of  correlation  functions*  The  auto- 
correlation function  of  v(t)  is  defined  as 

R(?r)  * v(t)v(t-«)  = < v( t)v( t=t')>  o 
In  terms  of  the  representation  of  Eq*  (1*6),  this  is 


♦Intensity  has  the  dimensions  of  voltage  squared*  We  use  the 
term  "intensity  spectrum"  rather  than  "power  spectrum"  to 
avoid  the  necessity  of  defining  the  resistance  in  which  the 
power  is  dissipated* 
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oo 


R(*0  = 


00 


m*l 


Camcos  ^ + bm  sin  V3 


° Cancoswn(  t~?)  +bnsinton(t-«')]^> 
Using  the  relations  of  Eq0  (1„7),  we  have 


R(tr) 


n=t 


r <ag> 

cos  <ont  cos  WR(t“t) 


+ <b^>  sin  o>nt  sinu>n(t~D) 

00^ 

U COS  GJnTTo 


n=l 


(1-9) 


The  autocorrelation  function  thus  consists  of  terms  equally- 
spaced  in  frequency.  If  we  pass  to  the  limit  as  the  interval 
of  definition  of  v(t)  is  made  infinite  in  length,  the  spacing 
2n/T  becomes  smaller  and  <a^> — W(f)df,  where  W(  f ) is  the  power 
spectrum.  In  the  limit,  the  sum  can  be  replaced  by  an  Integral, 
and  we  have 

oo 

R(0  » j W(f)  cos  2 rtf?  df  „ (1-10) 

c 

The  above  is  a demonstration  of  the  Wiener-Khint chine  theorem, 
which  states  that,  with  complete  generality,  the  autocorrelation 
function  is  the  cosine  Fourier  transform  of  the  intensity  spec- 
trum.. The  inverse  transformation  is 


CD 

W(f)  = 4 j R(v)  cos  2 nft  &C  o (1-11) 

jo 

The  value  of  the  autocorrelation  function  for?*  0 is  obviously 
the  mean-square  value  of  v(t),  while  the  value  of  the  autocorrela- 
tion function  of  a random  process  forr— >co  is  the  square  of  the 
mean  value.  Autocorrelation  functions  also  have  the  properties 
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wn  » h ( - ?r) , 

and  |R(r)|  si  R(0) . 

T,\e  normalised  XU asUPP  U o fun  useful,  It  *m 

be  written 

^ ■ 

and  has  the  property  that  p(0)  * I, 

Cxaia-correUUQn  flUKUOM  are  defined  In  an  analagwa  way. 


R^^Cr)  * W1(t)v^(t-*0  * < V,  ( t)V-(  t»f)  > * 
They  have  the  properties  that 

aU(r>  * R2i<-r> 


Ru(r)|  £ ^(OjB^Oi  , 

where  R-.-,r"  and  are  the  autocorrelation  functions  of 

v.  t ' and  v.(t),  respectively 


RfiX§Eaag&& 

1 For  an  excellent  general  introduction  to  the  mathematical 

description  of  noise,  see  Lawson,  J L, , and  0.  E Uhlenbeck, 
Threshold  Slgpali  McGraw-Hill.  New  York,  1950,  Chap,  III, 

A more  comprenensive  and  detailed  treatment  is  contained  in 
Sr  0.  Rice's  two  papers,  "The  Mathematical  Analysis  of  Random 
Noise  " fiftli  1°  21  j 282^332-  (194*),  and  21,  *6- 

158  (19 A 5),  while  for  a general  account  of  noise  and  signals 
in  nonlinear  systems,  see  Middleton,  D -,  , "Some  General  Re- 
sults in  the  Theory  of  Noise  through  Nonlinear  Devices," 

Quart.  Add!,  Math,  a.45^98  (1948)  4 fairly  detailed  bibliog 

raphy,  including  these  and  otner  references , listed  here,  is 
given  at  the  end  of  this  memorandum. 

2,  In  more  mathematical  language,  an  ensemble  is  ergodic  if  it 
is  stationary,  and  there  is  no  subset  of  the  functions  in 
the  ensemble  with  a probability  different  from  0 and  1 which 
is  stationary.  For  more  complete  discussions  of  the  ergodic 
property,  see  Shannon,  C,  E. , and  W„  Weaver,  The  Mathematical 
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<? 


y* 


Theory  of  Communication.  The  University  of  Illinois  Press* 
Urbana,  Illinois  \ 1949; » . pc.  51,  and  James^  Hu  lfn , N,  R, 
Nichols,  and  R*  Sc  Phillips,  Theory  $1  SaiYga££teiHfe < 
McGraw-Hill,  New  York,  1947,  Chap,  Vl7 

• '>  ' , 

3o  Middleton,  Do,  "On  the  Theory  of  Random  Noise}  Phenomenono 
logical  Models*  I,”  £*  APPl«  PhYSo  .22,  1143-1152  (195D- 

A Wiener , N , Tilfi  Fourier  Integral,  Dover,  New  York,  p*  70, 

5 Wiener,  N*  "Generalised  Harmonic  Analysis."  Acta  Math* 

55,  117-259  (1930;  Khintchine,  A,.,  "Korrelatlonstheorie 
statlonarer  stochastischen  Prosease Math..  Ann..  109, 
60/-615  (1934), 
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' •'SIGNAI-TO-NCISB  RATIO  AT  THE  OUTPUT  Of-  A CORRELATOR 

In  a - practical  application  it  is  not  possible  to  perform 
the  infinite  time  averaging  which,  as  indicated  in  the  previous 
section,  is  an  essential  part  of  the  computation,  of  a correla- 
tion function  The  best  we  can  do  electronically  1s  to  use 
some  .sort  of  low- pass  filter  as  an  averaging  network-  Because 
the  averaging  cannot  be  extended  over  an  infinitely  long  time  , 

there  appears  at  the  output  of  the  average?,  in  addition  to 

the  correlation  function  we  desire  to  measure,  a fluctuating 
voltage  which  we  can  call  the  output  noise  It  is  of  great 

interest  then  to  estimate  the  amplitude  of  this  output  noise, 

and  especially  what  might  be  called  the  output  signal- to*-.R.cise 
ratio  1 

Correlator,  gytfeffijS  lisaal-ls- Ratifi 

The  cean*squars  noise  (or  error)  in  the  output  of  a 
practical  correlator  can  be  found  as  the  difference  of  the  mean- 
square  of  the  actual  output  and  the  square  of  the  correlation 
function  being  measured.  For  example,  if  Rg(fyt)  is  the  actual 
output  of  the  correlator,  which  is,  of  course,  a function  of 
time,,  and  if  R(r)  =»  R (z  ,t’l  is  the  desired  (signal)  portion  of 
the  output,  the  mean-square  noise  Is 

[R  ft,t)  - R(f)]S  * R2fr,t)  - 2R(tr)R  (tr,t)  + R2(r) 

* o o 

- R^(t?t)  ~ 2R2(r)  e R2(r) 

W R2(^,t)  - R2(r) 
fe 

This  procedure  will  be  used  below  to  compute  the  output  noise 

If  f(t)  is  the  input  to  a filter,  the  output  is  given  by 


f (t")g(t--t")dtM  .. 


<7 


m2?  -12- 

which  can  be  written,  after  a change  of  variable, 

oo 


(S.2) 


where  fit's  is  the 


of  the  filter. 


the  properties.,  for  a st«ibU>  filter, 


git)  - 0,  for  t < o,  and  g(t)dt  * 1 

4- 


(2:2.: 


When  a correlator  is  used  to  no  a rune  an  autocorrelation  function, 
the  mout  to  the  filter  is  the  product  function 

ritlvlt-t;)  r 

We  car.  then  write  the  output  of  the  correlator  as 

or* 

R lt,t)  * f g(  V )vt  t*t  dt‘ 

8 / 

Its  ce an- square  value  is 


Elf*  ,t)  * f g{  V )v(  t-t’  )v*  t-t ; fldt5 

A 

"0 


g{  t •)v(t-tt)v(t~t*-r)  dt 


0 


If  we  cnar.^e  t in  the  second  integral  to  t"  to  distinguish  between 
tne  variables  of  integration*.  *t-  can  write  the  above  as  a double 
integral , 


g(  t 1 )g(  tH  )vf  t-t  * )v(  t~  t t)v(  t-  trt  )v(  t -tw~  r)dt  * dt” 


0 J0 


Interchanging  the  order  of  sunning  (integrating)  and  averaging, 
we  have 

°5» 


Rgft  r)  * g(  t’  )g(  tf1)  ■■  •r)v(t--t")v(t-tM-c)]dt'  dt". 


J0 


The  brackets  enclose  what  might  be  called  a third-order  autocor- 
relation function,,  In  Appendix  I,  an  expression  is  derived  for 
the  third-order  autocorrelation  function  of  a gaussian  random 
process,*  in  terms  of  the  ordinary  autocorrelation  function,,  By 
comparing  the  above  expression  with  the  first  form  of  Eq„  (Alo3) 
we  see  that  we  can  write 

v(t“t*)v(t«t,-tOv(t“tw)v(t---tM-t?)  = R2Cr)  + R^C  t,,-‘tl) 

+ R(t**-ts+r)R(t«-t«~r3 , 

where  R(b ) * v( t)v( t-f) ? the  ( ordinary) autocorrelation  function 
of  v(t}„  Then 


0 ‘'O 


g(t')g(t")  [R2(t)  +R2(t"4') 


+ R(tH  » t9+r)R(ttt-t*-tr3dt*  dt"’ 


To  simplify  this  expression,  we  note  that  the  variables  of  inte- 
gration appear  in  the  correlation  functions  only  as  t*6  — t * , and 
we  therefore  make  the  change  of  variables 

tK~t'  -*  tM+t3  •»  71 


whence 


The  Jacobian  of  this  transformation  is 


a=3 

2 


at1 

at” 

at 5 

at4 

dri 

9ti 

1/2 


♦At  this  point  we  must  restrict  our  consideration  to  gaussianly- 
distributed  random  signals  as  well  as  to  a gaussianly-dlstributed 
background  noisec  For  sinusoidal  signals,  for  example,  where 
vCt-t*),  v( t~t  ’“"S') , etCo . might  consist  or  a random  noise  plus  a 
sinusoid,  the  reduction  derived  in  Appendix  I is  not  valid,,  Our 
results  below  for  the  limiting  case  of  small  input  signal~to» 
noise  ratio  will  not  be  greatly  in  error,  however,  regardless  of 
the  character  of  the  signal,  since  the  distribution  of  the  gaussian 
noise  plus  small  signal  will  still  be  very  closely  gaussian,, 
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so  dt *dtn  * (l/2)d|  d^  . 

The  regions  of  integration  are  indicated  in  Fig.,  2,1,  We  see 


Fig,,  2«1  Regions  of  integration  in  the  t’,tM,  and  in 
the^-  .7)- planes, 

that  ri  must  be  integrated  f rom  j $ | to  + coand  from  ~o>  to  +a>c 
We  then  have 


dr|  g(I^)g(3l^)CR2(t) 

♦ R(^)R($)  + R(J5  + *)R0&-'tgd5,  (2.3) 

The  t] -integration  can  be  performed  directly,  since  r\  appears  only 
in  the  g -functions.  We  define  the  transformed  weighting  function 

CD 


Bjjct.x) 


(1/2) 


7 

15! 


which,  after  substituting  t = 


K£)  * (1/2)  j g(-^)g(-^)dt)  , 


2 2 
becomes 


w(|)*/  g(t)g(t+5)dt 


The  lower  limit,  which  might  just  as  well  have  been  taken  as  - oo, 
simply  serves  to  remind  us  that  the  weighting  functions  g(t)  vanish 


TM27  -15- 

for  negative  arguments «,  With  that  in  mind  we  can  write 


w C|) 


* 


CD 


g(t)g(t+'5)dt 


o 


It  Is  readily  seen,  however,  that  whenjg^>0. 


and , furthermore  , 


g(t)g(  t+5  5dt 


that 


> 


(2,4) 


w(-J)  - w(5)  , J 

Equations  (2.4)  are  the  most  useful  form  for  evaluating  the 
transformed  weighting  function.  It  is  readily  demonstrated 

that 


w 


(|)d^  » 1, 


(2,5) 


- CD 


In  terms  of  w(jO , as  defined  above,  we  can  write  Eq.  (2.3) 


co 


R2<t/f)  « R2(t)  + J w(|)  [R2(j)  + R<£+*)R(|~«)3dJ7 

" 00 

The  mean  square  of  the  correlator  oiJtput  noise  is  then 

CD 

«cmrp2,'r\  + 

» 


___ 

Rg(t(T)  - R2(f)  * J w(|)CR2(p  + R($  + t)R(5-t)]d$  , (2.6) 


OD 


and,  taking  as  the  signal  the  average  output  of  the  correlator, 
the  mean-square  output  signal^to-noise  ratio  is 


(S/N) 


OUt  CD 


(2.7) 


f w(/)[R2(|)  + H(§+f)R(5-f)3d^ 

“CD 


When  the  correlator  Is  used  to  measure  a cross-correlation 


function,  the  input  to  the  averager  is  the  product  function 

vA(t)vB<t~t) 

■and,  using  the  first  form  of  Eq»  (Al„4),  ire  can  show  by  the 
same  method  as  above  that  the  mean-square  output  signal-to- 
noise  ratio  is 


(s/s)out  - 


H|g(r) 


w('S)  !Raa(Uhbb(5)  + HAB(i+<0RBA(J-*)M$ 


"CD 


(2,  8) 


3ei£hti Qg  g\mtt.ig,as 

The  evaluation  of  a correlator's  output  signal- to-noise 
ratio  depends  upon  the  weighting  function  of  the  averager  which 
is  used,  and  more  specifically,  in  the  above  formulation,  on  the 
transformed  weighting  function.  The  weighting  functions  and 
transformed  weighting  functions  for  three  simple  averagers  will 
be  given  below. 


The  weighting  function  of  a filter  network  is  its  impulse 
response,  or  output  for  a delta-function  input,  initiated  at 
time  t = 0,  and  may  conveniently  be  found,  for  stable  filters, 
as  the  Fourier  transform  of  the  voltage  response  spectrum  of  the 
filter,  which  is  simply  the  complex  ratio  of  the  open-circuit 
output  voltage  to  the  input  voltage.  For  the  low-pass  averager 
of  Fig,,  2,2,  the  voltage  response 
spectrum  is 


!o  , 

•.  R + 1/jwC  ’ 


and  the  weighting  function  is 
readily  determined  to  be 
, -t/RC 

3 ‘gjn  e 3 t > 0^ 


0, 


t < 0, 


R 

O WA r 


■? — — -o 


gCt) 


e 


Fig,  2, 2 
Network, 


RC  Averaging 


Then  from  Eqs.  (2.4),  we  find  the  transformed  weighting  func- 
tion  to  be 

w(§)  * 2RG  e > for  (2.9) 

A simple  and  quick  comparison  of  different  averagers  may  be 
made  on  the  basis  of  their  responses  to  a unit  step  input. 

Just  as  the  unit  step  is  the  integral  of  the  unit  impulse,  the 
response  of  a network  to  a unit  step  is  the  integral  with  re- 
spect to  t of  the  impulse  response.  Calling  the  unit  step 
response  U(t),  we  have,  for  the  RC  network* 

U(t)  - 1 - e~t/RC,  t > 0. 

In  the  same  way,  these  three  functions  may  be  determined 
for  the  critically  damped  RLC  cir- 
cuit of  Fig.  2.3.  The  voltage 
response  spectrum  is 


m at  - — 1— ■ 

ei  1 ♦ J jfrw  - L’C'o)2 

and  critical  damping  occurs  when 
R’  - VL ' 7C~' , making  the  voltage 
spectrum  for  this  case 

l . 

(1  + J \ /^7W)2 

The  weighting  function  is  then 

eCt)  - — i — = t e-t/R-c.  t 

4(R'C»)2 

and  the  transformed  weighting  function  is 

, -|j|/2R'Cs 

*0)  1 -5  [2R'C'  + |$|]e 

16(R  !C'  )2 


L' 


Fig.  2.3.  Critically  damped 
RLC  averager.  (R--$/T» v£T) « 


The  unit  step  response  is 
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<? 


H 


U(t)  * 1 - (1  + V 2R,C,)e 


»t/2R 5 C ? 


t > 0. 


The  response  of  a finite-time  "perfect  averager"  to  an 


input  function  f(t)  is 


1_ 

Ti 


where  is  the- length  of  the  interval  over  which  the  average 
is  computed.  By  comparison  with  Eq„  (2,1)  we  see  that  the 
weighting  function  is 

g(t)  * 1/T1?  0 < t <1^ 


» 0 , t < 0 and  t > T.^  „ 

No  realizable  network  has  this  weighting  function$  it  is,  how- 
ever, mathematically  convenient  for  comparison  purposes,  and, 
if  necessary,  its  operation  could  be  approximated  by  various 
arrangements,  one  of  which  is  shown  schematically  in  Fig*  2. &. 


2R. 


Fig,  2»4,  Circuit  for  Approximating  Operation 
of  a Finite-time  Perfect  Averager* 

The  transformed  weighting  function  is 


'(*)  - fj-  (1  - 1*1 Ax), 
* o. 


and  the  unit  step  response  is 

1 


U(t)  - t/T,  , 


IllSh? 


o < t < I j 
t > T^. 
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These  three  averaging  systems  may  be  compared  by  examining 
their  step  responses  after  adjusting  their  time  constants  so 
that  their  noise-reducing  properties  for  wideband  input  noise 
are  the  same.  Equation  (2.6)  gives  the  mean-square  value  of  ' 
the  noise  at  the  output  of  the  averager.  Nov/  the  range  of  't 
over  which  a correlation  function  R(t)  is  appreciably  differ- 
ent from  zero  is  roughly  equal  to  the  reciprocal  of  the  signal 
bandwidth.  Similarly,  the  extent  of  the  transformed  weighting 
function  w($  ) is  inversely  proportional  to"  the  width  of  the 
pass-band  of  the  averaging  network.  For  good  smoothing  the 
pass-band  of  the  averager  must  be  small  compared  to  the  band- 
width of  the  signal.  Usually,  therefore,  the  principal  contrl- 
button  to  the  integral  of  Eq.  (2.6)  comes  in  the  region  where 
wO)  is  not  substantially  different  from  w(0)»  In  this  case, 
then,  Eq.  (2,6)  may  be  replaced  by  the  approximate  form 


Rg(t,t)-R2(r) 


w(0) 


7 CR2(f)+R(5+£)R(5-*03ds. 

- oo 


The  mean- square  noise  output  for  a given  (wide)  input  spectrum 
Is  therefore  proportional  to  w(G),  Numerical  values  of  the 
time  constants  of  the  three  averaging  networks  discussed  above 
were  chosen  so  that  w(0)  was  the  same  in  all  three  cases,  £hd 
the  resulting  weighting  functions,  transformed  weighting  func- 
tions, and  responses  to  a unit  step  are  plotted,  to  the  same 
scale,  in  Pigs.  2.5,  2.6 , and  2.7*  respectively.  It  is  to  be 
noted  that  the  rise  times  are  roughly  equal  when  the  noise- 
reducing  properties  are  equal.  There  does  exist  an  advantage 
in  using  the  optimum  filter  for  a given  input  function^  this 
will  be  discussed  in  a following  section. 


Output  aifinQl-Sa-flalaa  Baglai  specific  Mmal&s. 

The  correlator  output  signal-to-noise  ratio  was  shown  in 
Eq.  (2,8)  to  depend  on  the  transformed  weighting  function  of 
the  averager  and  on  the  auto-  and  cross-correlation  functions 


i 
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of  the  inputs . Using  the  transformed  weighting  function  given 
in  the  preceding  section  for  the  RC  averager,  and  the  autocorre- 
lation functions  derived  in  Appendix  II,  we  can  reduce  Eq„  (2=8) 
to  a much  simpler  expression,  subject  to  a few  restrictive  condi- 
tions which  often  pertain,  We  assume  first  that  the  two  inputs 
to  the  correlator  are  made  up  of  various  combinations  of  two 
random  noises  n^(t)  and  ngCt),  of  equal  amplitude,  and  a noise 
signal  s(t),  all  three  being  statistically  Independent  and 
having  the  same  rectangular  spectrum  of  half -width  ,\t  and  center 
frequency  f.  These  signals  then  have  the  autocorrelation  func- 
tions 


\(r) 


cos2rrf.  T 
o 


r2CO  * ccs2rrf0t 


R3(r) 


sc 


a naftr  ' 


COS2nf  “T 


Where  N and  S are  the  mean-square  values  of  the  noise  and  the 
signal,  respectively..  We  assume  that  the  correlator  uses  an 
RC  averager,  and  we  use  the  transformed  weighting  function 
given  in  Eq0  (2,9)0  Now,  as  we  noted  above,  if  the  pass-band 
of  the  averaging  network  is  small  compared  to  the  bandwidth 
of  the  signal,  we  may  assume  that  the  principal  contribution  to 
the  Integral  in  Eq*  (2,8)  comes  in  the  region  where  w(£)  is  not 
substantially  different  from  w(0).  Subject  to  this  assumption 
that  1/RC  « Af , Eq,  (2,8)  becomes  (with  if  set  equal  to  zero,  to 
give  the  maximum  signal  output,  the  signal  s(t)  being  assumed 
present  in  both  channels  without  relative  delay) , ■ 


(S/N) 


RfgtO) 


out 


2 RC  / »AA<5>  RBB^  + RAB^*BA^^dJ 


l 


We  consider  four  different  modes  of  operation 


* 


i 

FINITE- TIME  PERFECT  AVERAGER 


| W(£) 


RC  LOW -PASS  NETWORK 


£ 

CRITICALLY -DAMPED  RLC  NETWORK 


Fig.  2,6.  Transformed  weighting  functions  for  three  averagers 


t 

FINITE-TIME  PERFECT  AVERAGER 


U(t) 


RC  LOW-PASS  NETWORK 


CRITICALLY-DAMPED  RLC  NETWORK 

Fig.  2.7.  Unit  step  responses  for  three  aTeragers. 
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I.  Both  Inputs  s(t);  In  this  case  we  have  the  maximum 
output  signal-to^noise  ratio  which  occurs  in  the  measurement  of 
an  autocorrelation  function  or  the^signal-to-noise  ratio”  for 
the  measurement  of  the  mean-square  of  s(t)„  We  have 

so 

( S/N)  * — 5— 

~lg  / fi'>Z  cos22nf0?d/ 

“ 00 


, 2MLu 

n > 

where  hu>  = 2nhf0  We  see  for  the  first  time  here  the  very  general 
and  well-known  result  that  the  output  mean-square  signal-to-noise 
ratio  is  proportional  to  the  product  of  the  input  bandwidth  and 
the  output  time  constant* 


II  Both  inputs  Cn-^C  t) +s(  t)  1 s Here  the  correlator  is 
simply  used  as  a square-law  detector  to  determine  the  presence 
of  a signal  in  noise*  We  have 


*AA  ^ * RBB^  * RAB^  = RBA(^  = (N+s)  S2nff^^ 

cos2"'rf  £ * 


The  d-c  output  in  this  case  is  RAg(0)  = N + S»  We  take  as  the 
output  signal  simply  S,  assuming  that  the  d-c  voltage  N can  be 
biased  out,  or  ignored.  The  output  signal-to-noise  ratio  is 
then 


<S/N>out  ’ 


^ J (f^^os^d* 

- CD 


2S2  RC  Atu 
n(N+S)2 


r* 
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and, -if  S « N, 


■ 22- 


(S/N)out  « ^ CS/N)fn 


III*  One  _Input  [n1(t)+s(t)l.  other  input  Is  git)  ^sjtUx 

The  correlator  is  used  here  to  determine  the  presence  of  a 
common  signal  in  two  different  samples  of  signal  in  noise., 

‘ ^ e°s2"fo? 

W5>  ' »BA(5>  - s a&ff®  cosZnt03 


and 


(S/N) 


4S^  RC  Ao) 
out  [(N+S)2*  S23 


In  the  limiting  case  where  S«  N, 


WWout  * (S/N5fn 


iv . One  Input  [nx(t)  + s(t)lT  other  input  VK75  s(t) s 

Here  a standard  sample  of  the  signal  of  constant  mean-square 
amplitude  N is  cross-correlated  with  the  signal  and  noise..  We 
have 

Raa(J)  - CN+S)  (S|^£i)c0s2nfo5 


Bbb<3)  - » cos2nf0^ 

RAB^  = RBA^P  * ^ (S2^?Z*‘]c0s2Trfo* 


and 


(S/N)  out  = " , 
out  [N(N-tS)  + NS ] tt 


which  becomes,  if  S«N, 
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(S/N)oiit  « CS/N)In  . 

la  this  mode  of  operation.  the  output  signal- to-nolso  ratio  i$  pro- 
portional to  the  fly st  power  of  the  input  signal- to-fidia#  ratio*, 
resulting  in  an  a 3 van  tare  of  a factor  £ i.0  desjbfla  over  the  othfp 
arrangoEsnts  above,,  for  small  Input  signal- to-nolao  ratios,  fh« 
process  from  which  this  saving  results  is  known  a®  "pradatactor 
integration,*1  and  always  involves  knowing  the  instantaneous  mVk~ 
form  (phase)  of  the  signal  being  sought*  This  is  the  principle 
tehird  so-called  phase  or  coherent  detectors.  In  cases  II  and  III* 
where  the  small-signal  output  signal- to~noise  ratio  is  proportional 
to  the  square  of  the  Input  si goal- to- noise  ratio,  we  have  the  ohe- 

4 

nooenon  of  ” signal  suppression,-” 

Ccmna risen  of  cases  II  and  III  for  the  square -law  detector 
and  tr.w  correlator  must  be  made  very  carefully  The  results 
sieve  show  that  if  two  samples  of  the  same  signal  In  incoherent 
bsrkgrcund  noises  are  available,  the  correlator  can  o reduce  a $i& 
r.%1  -to-ncice  ratio  3 db  better  than  that  of  the  square -law  d»teo:; 
tor  (operating  on  cne  sample  of  the  signal  in  noise).  Obviously,, 

If  two  ran pie s of  the  signal  in  incoherent  noises  are  available, 
trey  can  be  added  and  applied  to  the  square-law  detector.,  where, 
with  the  incut  signal- tc-noise  ratio  Increased  by  3 db,  the  vui- 
a. it  signal- to-noi.se  ratio  will  be  increased  by  6 d,b,  a result 
} ib  b-itcer  than  for  the  correlator  the  correlator,  on  the 
other  hand,  -©reduces  no  d-c  output  independent  of  the  signal,  a 
practical  advantage  that  should  not  be  overlooked 

For  tne  case  of  noise  whose  spectrum  is  that  of  a single- 

tuned  resonant  circuit  of  at  least  moderately  high  Q,  we  uco  the 

autocorrelation  function  derived  In  Appendix  II, 

«-( >i  irl 

BC'J')  s e * cosw  m., 

o 1 

where  Wy/lrr  is  the  half- bandwidth  to  the  half-power  point,  and 
»,/an  is  the  center  frequency  Assuming,  a.*:  noforn,  thud 
l/‘HC«.u>y,  and  also  that  aj y <■<&)  , no  1 hut  with  Hit  1*»  t*rr»<r 
we  may  replace  the  £ by  its  avnr/xpu  valu<  O '/)  w»» 
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The  fomilas  derived  above  for  the  rectangular  spectrum  may  then 
t«  spec  Sal xsed  tc  the  case  of  the  tuned- circuit  spectrum  of 
r * Jerately  high  -Q  by  replacing  the  factor-  A^ui~'  * 

Thes#  output  slgnal-to-noise  ratios  are  summarized  for  the  two 


cm** 3 In.  Table  2.1. 

AvfrTiger  Efficiency  and  On Vimum  Filters 

Unfortunately,  the  signal^ta-noise  ratios  derived  theoreti- 
cally In  the  preceding  section  are  never  achieved  in  practice. 

Yf  was  assumed  in  the  derivation  that  the  d-c  signal  In  the  out- 
rut  of  the  averager  had  built  up  to  its  ultimate  value,  while  with 
“re  exception  tf  the  finite-time  perfect  averager,  this  requires 
an  infinitely  long  time.  In  practice,  either  because  the  re- 
ceiver is  scanned  in  one  or  more  angular  dimensions,  or  because  of 
the  transitory  nature  of  the  signals  themselves,  an  infinitely 
long  observation  time  is  .not  available . If  one  used  an  averager 
with  such  a short  time  constant  that  the  d-c  signal  in  the  out- 
put does  very  nearly  attain  its  ultimate  value  during  the  epoch  of  th 


^Although  the  integration  could  be  carried  out  easily  without 
replacing  the  cos*-  by  its  average,  it  would  not  be  exactly 
correct  to  do  so,  since  the  more  exact  form  of  the  autocorrelation 
function  for  1 ov/->Q  circuits  (see  Appendix  II)  should  be  used  in 
the  wide -band  case. 
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signal,  then  one  is  not  obtaining  the  greatest  possible  output 
signal- to-noise  ratio  because  increasing  the  time  constant  will, 
for  a while,  cause  the  noise  to  decrease  faster  than  the  signal*, 
It  is  therefore  important  to  consider  the  time -functional  form 
of  the  signal  as  it  appears  at  the  input  to  the  averager,  and 
the  general  problem  of  specifying  the  optimum  type  of  averager 
for  detecting  the  presence  of  that  signal  in  noise.  We  here 
define  the  optimum  averager  (for  a signal  of  finite  duration) 
as  that  one  which  produces  the  greatest  peak -signal- to-rms- 
nolse  ratio  at  its  output..-  It  is  not  necessarily  true  that 
such  an  averager  produces  at  the  same  time  the  most  easily 
discernible  signal  (in  the  presence  of  noise)  to  the  eye*,  It 
is  reasonable  to  assume  that  this  is  a fairly  satisfactory 
criterion  of  detectability,  however,  and  it  is  mathematically 
convenient.  Woodward, by  applying  the  theory  of  inverse  proba- 
bility, has  specified  much  the  same  criterion  for  extracting  the 
greatest  possible  amount  of  information  from  a radar  signal. 
Other  optimum  filter  criteria  have  been  used^  for  examples 

(1)  minimization  of  the  mean-square  error^(best  possible  re- 
covery of  the  shape  of  the  input  signal)  and  a closely  related 

7 

method  of  minimizing  an  arbitrarily  defined  "distortion,  and 

(2)  minimization  of  the  mean-square  error  in  determining  the 
average  value  of  a noise  wave  (or  of  measuring  a steady  d-*c 
voltage  in  the  presence  of  noise)  when  there  is  only  a finite 

O 

time  available  for  the  measurement. 

It  has  been  shown  by  Van  Vleck  and  Middleton^  that  the 
filter  which  gives  the  best  output  peak- signal- to-rms-noise 
ratio  when  the  input  noise  bandwidth  is  much  larger  than  that 
of  the  signal  pulse  is  simply  that  filter  whose  weighting  func- 
tion is  proportional  to  the  time-functional  form  of  the  signal 
backwards*,  * (The  result  was  expressed  originally  in  spectral 
language,)  This  optimum  filter  is  called  the  ’‘matched"  filter, 

♦The  weighting  function  of  a physically  realizable  passive  net° 
work  must  vanish  for  negative  arguments*,  This  makes  difficult 
the  problem  of  constructing  a passive  filter  to  match  a pulse 
whose  time- functional  form  extends  a considerable  distance 
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Their  mathematical  proof  will  not  be  repeated  here^  it  was 

applied  by  them  specifically  to  the  case  of  a pre-detection 

filter  on  the  basis  of  maximizing  the  post -detector  slgnal-to- 

noise,  ratio,  but  exactly  the  same  arguments  may  be  applied  in 

this  case.  Van  Vieck  and  Middleton  state  further  that  if  the 

optimum  pre-dec’ action  filter  is  used,  no  post-detection  filter 

10 

can  improve  the  signal- to- noise  ratio,  further*  In  a correla- 
tion system,  on  the  other  hand,  pre-multiplication  filters  are 
used  (with  broadband  signals)  mainly  to  determine  the  shape  of 
the  correlation  function  being  measured,  by  establishing  the 
signal  spectrum,  the  signal  at  the  output  of  the  correlator 
being  determined  In  many  cases  by  the  relative  delay  of  the 
two  input  signals  rather  than  by  modulation  of  a carrier® 

The  greatest  part  of  the  signal- to-noise  ratio  improvement  by 
filtering  must  then  be  obtained  in  a post- multiplication  filter. 

We  here  define  the  "efficiency"  of  an  averager  for  a signal 
of  finite  duration  to  be  the  output  peak. -signal-squared- to-mean- 
sauare-nol se  ratio  divided  by  that  same  quantity  for  the  matched 
filter  Efficiency  thus  is  a numeric  which  runs  from  0 to  1, 

Our  averager  efficiency  differs  from  that  defined  by  Eckart^ 
in  that  we  assume  that  the  background  noise  has  always  been 
present  at  the  input  to  the  filter,  while  he  assumed  that  the 
noise  and  signal  were  applied  simultaneously.  We  feel  that 
our  definition  is  more  .realistic  for  the  case  where  the  receiver 
is  ”onlf  continuously  and  signals  arrive  at  the  input  from  time 
to  time.  The  efficiencies  have  been  computed  by  very  straight- 
forward methods,  by  finding  the  peak  value  of  the  transient 
response  of  the  filter,  squaring  that  value,  and  dividing  by 
the  transformed  weighting  function  of  zero  argument,  which* as 

either  side  of  its  peak  or  center.  However,  one  method  has  been 
suggested  for  constructing  an  active  filter  which  can  have  weight- 
ing functions  that  do  not  necessarily  vanish  for  negative  argu- 
ments (see  Refo.  7 above).  If  the  pulse  is  symmetrical,  there 
is  an  advantage  of  3 lb  in  using  the  symmetrical  weighting 
function  over  using  (the  physically  realizable)  half  of  it.. 
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we  showed  above,  is  proportional  to  the  me an- square  noise  out- 
put, when  the  averager  band-pass  is  narrow  compared  to  the  in- 
put bandwidth,  and  normalizing , The  illustrations  below  are 
thus  valid  only  for  relatively  wlde-band  input  background  noise. 
Averager  efficiencies  for  detection  of  a rectangular  pulse  of 
length  Tq  are  plotted  in  Fig,  2,8,  for  the  three  averagers 
whose  weighting  functions  were  given  above.  The  abcissa,  x,  is, 
for  the  finite-time  perfect  averager,  T^/TQ$  for  the  RC  averager, 
2RC/T  i and  for  the  critically  damped  LRC  circuit,  SR'C'/T  , It 
can  be  seen  that  the  time  constant  of  the  averager  must  be 
adjusted  carefully  to  the  pulse  to  achieve  the  best  signal- to- 
noise  ratio,  and  particularly  so  in  the  case  of  the  finite-time 
perfect  averager. 

Averager  efficiencies  for  detection  of  a "backwards"  expon- 
ential pulse  having  the  time -functional  form 

t/T 

f(t)  - e °,  t £ 0, 

* 0,  t > 0, 

are  plotted  for  the  same  three  averagers  in  Fig,  2,9*  In  this 
graph,  x is  RC/TQ  for  the  RC  averager^  T-^/^  for  the  finite-time 
perfect  averager^  and  8R,C!/T0  for  the  critically  damped  LRC 
circuit.  The  backwards  exponential  pulse  was  chosen  to  match 
the  RC  averager,  and  the  advantage  of  this  filter  over  the  others 
is  clearly  apparent.  As  here  defined,  averager  efficiency  is 
proportional  to  relative  peak-signal-squared- to-mean-square- 
noise  ratio,  so  that  a decibel  scale  can  be  used  to  compare 
the  different  averagers,  A decibel  scale  has  therefore  been 
added  to  the  right-hand  side  of  Figs,  2,8  and  2,9c  The  differ- 
ences between  these  three  filters  in  the  region  near  x = 1 are 
thus  seen  to  be  rather  small  in  decibel  measure. 

By  reference  to  Figs,  2,8  and  2,9  it  may  be  seen  that  the 
degree  to  which  a filter  is  optimum  is  closely  related  to  the 
extent  to  which  its  weighting  function  matches  the  pulse  being 
detected.  One  would  therefore  expect  that  an  RC  averager,  for 
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example,  would  be  a relatively  poor  averager  for  the  detection 
of  the  presence  of  a signal  pulse  having  the  form  of  a correla- 
tion function  such  as  that  shown  in  Pig.  2,10.  This  is  the 
autocorrelation  function  of  random  noise  having  a spectrum 
equal  to  the  intensity  response  of  a tuned  circuit  with  Q c 8. 
Approximate  calculations  have  been  made  comparing  the  RC 
averager  with  the  best  time  constant  for  the  purpose  with  the 
matched  symmetrical  (physically  unrealizable)  filter.  For 
fairly  high  Q ' s it  was  found  that  there  is  an  improvement  in 
the  peak-signal-squared- to-mean- square-noise  ratio  of  approxi- 
mately a factor  Q„  This  improvement  factor  diminishes  to  unity 
as  Qr — ^0*  It  Is  noteworthy  that  the  optimum  filter  for  such  a 
correlation  function  is  not  an  averager  but  a band-pass  filter! 
This  is  the  best  filter  for  detecting  the  presence  of  correlation 
but  not  the  best  filter  for  an  accurate  measurement  of  the  corre- 
lation function,  wnich  requires  a d-c  measurement* 

Incidental  to  the  above  calculations,  the  relative  efficiency 
of  an  RC  averager  for  the  detection  of  a sinusoid  of  frequency 
w /2rr  in  wide -band  noise  has  been  commuted  and  Is  displayed  in 
Pig  2,11  as  a function  of  the  product  RC^0-  The  maximum 
efficiency  occurs  at  RC  « 1/oj  ; this  may  be  taken  as  an  approxi- 
mate best  value  of  the  time  constant  RC  for  the  detection  of  a 
correlation  function  of  the  form  of  Fig,  2,10,  where  w/Zn  is 
the  frequency  of  the  modulated  cosine  wave  of  the  correlation 
function  as  it  appears  at  the  output  of  the  multiplier 

Xt  is  possible  that  the  filtering  process  might  be  re- 
placed by  a correlation  method,  especially  for  the  purpose  of 
achieving  nonphyslcally  realizable  weighting  functions.  If  an 
electrical  function  generator  could  be  constructed  to  generate 
the  desired  weighting  function,  the  operations  of  multlDltca ti on 
and  integration  indicated  In  Eq , (2-1)  could  be  performed  elec- 
tronically- (This  would  require  at  least  an  approximation  to  a 
finite-time  perfect  averager  to  perform  the  indicated  integra- 
tion.,) This  method,  would  be  somewhat  complicated  by  the  fact 
that  each  different  possible  time  of  arrival  of  a signal  would 


Fig.  2:.  10.  Autocorrelation  function  of  tuned -circuit  noise;  Q * 6. 
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have  to  be  Investigated  separately,  -while,  with  a passive  filter 
we  have  simply  to  observe  the  output  as  a function  of  time  and 
note  at  what  time  a signal  appears,-,  Either  a multichannel  sig- 
nal processer  or  a receiver  which  would  record  the  received 
signals  for  later  high-speed  playback  and  processing  might  make 
s\jch  a system  feasible * 
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ELECTRONIC  CORRELATORS 

A correlator  is  assumed  to  consist  of  a multiplier  and 
an  averaging  network  or  output  filter.  We  have  discussed 
filters  in  the  preceding  chapter,  and  therefore  the  problem 
of  the  design  of  a practical  correlator  reduces  to  that  of 
designing  the  multiplier.  An  electronic  multiplier  is  an 
electronic  circuit  whose  instantaneous  output  voltage  is 
proportional  to  the  product  of  the  instantaneous  values  of  its 
two  input  voltages.  We  have  given  consideration  only  to  elec- 
tronic multipliers  although  there  are  a good  many  other  methods 
of  performing  the  multiplication  of  the  two  input  signals.  It 
was  desired  to  keep  the  apparatus  simple  and  rugged,  and  to 
make  it  possible  to  use  various  electrical  filters  as  averag- 
ing networks.  For  these  reasons,  w^  have  not  used  dynamometer 
or  wattmeter  systems  (where  the  average  force  between  two  coils 
carrying  currents  proportional  to  the  input  signals  is  propor- 
tional to  the  average  product  of  those  signals).  Sampling 
1 P 

correlators  or  digital  correlators,  although  inherently 
capable  of  considerable  accuracy,  fall  into  the  clase  of  labora- 
tory instruments  or  computing  machinery,  and  are  too  complex 
for  purposes  of  signal  reception.  One  electronic  multiplica- 
tion scheme  reported  in  the  literature^  has  also  been  considered 
more  complex  than  necessary  for  these  purposes.  In  this  arrange- 
ment, the  frequency  of  a carrier  is  modulated  in  proportion  to 
one  of  the  multiplicands  and  its  amplitude  is  modulated  in  pro- 
portion to  the  other.  The  resulting  signal  is  fed  to  a phase 
discriminator  whose  average  output  is  proportional  to  the 
required  product,  A good  many  other  possible  schemes  of  multi- 
plying two  voltages  will  come  to  mind,* 

Two  types  of  electronic  multipliers  have  been  considered 
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in  some  detail^  these  are  multigrid- vacuum-tube  multipliers,  in 
which  signals  applied  to  different  control  grids  of  a multigrid 
tube  are  directly  multiplied  together  in  the  plate  current,  and 
multipliers  based  on  the  "quarter-difference-squares  method”  of 
multiplication,  which  reduces  the  problem  to  one  of  addition  and 
squaring  . 

MUIUfiClfl  galJtlBllaia 

This  circuit  makes  use  of  the  type  6AS6  pentode,,*  In  this 
tube,  the  total  (cathode)  current  is  controlled  mainly  by  the 
grid  voltage,  and  the  fraction  of  this  current  which  reaches 
the  plate  is  controlled  mainly  by  the  suppressor  voltage » 

The  plate  current  then  depends,  in  a 3ense,  upon  the  product 
of  the  grid  and  suppressor  voltages.  A multiplier  can  be 
built  in  the  form  shown  in  Figo  3-1=  To  adjust  this  circuit 
for  accurate  operation,  it  is  necessary  to  balance  the  d-c  grid 
and  suppressor  voltages,  and  the  a-c  (signal)  grid  and  suppressor 
voltages,  first  for  each  pair  of  tubes,  and  then  from  pair  to 
pair,.  While  this  arrangement  permits  perfect  balancing-out  of 
error  terms  up  to  the  second  order,  the  large  number  of  adjust- 
ments makes  it  unwieldy  to  use.  Fortunately,  some  simplifica- 
tions can  be  made  in  the  multiplier  when  it  is  used  as  a signal 
processing  device.  We  need  a multiplier  whose  average  output  is 
proportional  to  the  average  product  of  the  inputs,  not  necessarily 
one  which  generates  the  instantaneous  product.  Furthermore,  we 
are  concerned  only  with  input  signals  which  have  zero  average 
value,  and  which  are  usually  symmetrically  distributed  in  ampli- 
tude. For  these  reasons,  it  does  not  matter  if  the  input  signals 
themselves  appear  at  the  output  of  the  "multiplier,”  since  they 
will  be  averaged  out  and  will  contribute  no  error.  Thus,  if  it 
is  recognized  that  the  output  is  to  be  averaged,  we  may  use  the 
circuit  of  Fig.  3«2.,  which  uses  only  two  tubes.  A detailed 

♦The  use  of  this  type  of  circuit  was  first  suggested  to  us  by 
Dr.  Peter  Elias  of  Harvard  University.  Dr.  Elias  has  applied 
for  a patent  covering  multiplier  circuits  of  this  general  type. 
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analysis  of  this  circuit  will  best  demonstrate  how  it  works „ A 
schematic  diagram  of  a practical  circuit  of  this  type  is  shown 
in  Fig„  3°3» 

In  tube  No,  1,  we  assume  that  the  total  cathode  current  is 

*kl  = a01  4 all®gX  4 a21egl  4 001,0 

and  that  the  fraction  of  that  current  which  reaches  the  plate 
is 

al  * ipl/1kl  * b01  4 bllesl  4 b2lesl4° 0 ° 0 ° i 

where  e^  is  the  signal  voltage  on  the  grid  and  es^  is  the  sig- 
nal voltage  on  the  suppressor.  Then  the  plate  current  is 

ipl  = a01b01+  a01bllesl+  allblleglesl4  a03b21®sl 

4 a21b01®gl  4 allb21®gl®sl  4 a21blleglesl 

i v .2  2 . 

a21D2l®gl®sl 

In  tube  No,  2«  with  the  sign  of  opposite  that  of 

1k2  * a02  ' a12®g2  4 a 22®g2  4 0 0 0 0 ? 

a2  * b02  4 b12es2  4 b22es2  4 0000  » 


and 


I.:.  = jLn«b-i  /•.8, « “ 3i  i>ibn^6_o  ~ ^ 
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02^02  *02u12  s2  12  02  g2  ~ a12ul2's 2 a02u22"a2 

4 a22b02®g2  " a12b22eg2®s24  a22b12eg2®s2  4 a22b22®g2es24° 


The  difference  of  these  plate  currents  is  then 

'’  a01b01  " a02b02)  4 a01bllesl  “ a02b12es24  allb01egl+  a12b02eg2) 

4 (allblleglesl+  a12b12eg2®s25  4 (a01b21esr'  a02b22es2) 4(a21b01egl 

~ S22b02eg2?  4 (allb2leglesl4  a12b22eg2es2)  4 (a21blleglesl 
° a22b12eg2es2)  4 (a21b21eglesl  ~ a22b22eg2es2^  4 
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'The  circuit  is  balanced  for  operation  as  follows*  We  first  set 
a01  * a02  adjusting  the  d-c  grid  voltages  (Balance  No.  1 in 
rig,  3„3.  With  matched  120*** chin  resistors  in  the  cathode  oir cu it 
the  cathode  currents  in  the  two  tubes  will  be  equal  when  the  cath- 
odes are  at  the  same  voltage,)  Then  an  adjustment  of  the  d-c 
suppressor  voltages  (Balance  No.  2)  will  make  the  sum  of  the 
terms  in  the  first  parentheses  zero.  (The  63, 000 -ohm  plate  re- 
sistors are  also  matched,)  The  terms  In  the  second  pair  of 
parentheses  all  have  re.ro  average  Value  provided  that  the  signal 
inputs  have  rero  average  value,  and  therefore  they  contribute 
nothing  to  the  d-c  output.  The  third  pair  of  parentheses  enclose 
the  wanted  output  terms.  The  fourth  and  fifth  parentheses  enc" 


error  terms  proportional  to  the  squares  of  the  input-  signals,  and 
these  can  be  made  rero  by  adjusting  the  relative  amplitudes  of 


and  e . 


and  e_ , and  e. 


? ^ o hu  ^ ttuu  ©S2’  In  the  circuit  of  Fig, 3 .3,  this  is 

accomplished  by  first  applying  an  a-c  signal  input  to  the  grids 

cn.iy  and  adjusting  the  balance  No,  3 control  for  zero  d-c  output, 

then  by  applying  an  a-c  signal  to  the  suppressors  only,  and  adjust- 

Ing  the  balance  No,  4 control  for  zero  d-c  output.  The  sixth  wait 

2 

cf  parentheses  enclose  terms  proportional  to  e^-  eg  which  cannot 
be  balanced  out,  but  which  for  sinusoidal  or  symmetrically  dis- 
tributed noise  signals  have  zero  average  value  and  contribute 
nothing  to  the  d-c  output.  It  is  possible  that  a signal  having 
zero  average  value  but  unequal  moments  either  side  of  the  axis 
could  contribute  a large  error  at  this  pointy  in  using  this  cir- 
cuit with  such  unsymmetrical  waveforms  care  should  be  taken  to 
determine  whether  such  errors  are  negligible  or  not.  The  remain- 
ing terms  in  the  last  narentheses  are  small  and  nearly  balanced 
out. 

Measurements  of  the  characteristics  of  6AS6's  indicate  that 
the  following  are  good  operating  conditions  for  multiplier  uses 
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The  characteristics  axe  fairly  linear  for  a peak  grid  swing  of 
l v and  a peak  suppressor  suing  of  2 v.  The  perfornwm&w  of  the 
multiplier  as  a square?  was  checked  fey  applying  fcho  same  sinu- 
soidal •foliage  to  both  inputs  and  plotting  the  square  root  of 
the  d-c  output  voltage  against  the  a ~c  input  voltage*  The 
resulting  curve  was  quite  linear  for  input  voltages  up.  to  the 
limits  given  above. 

As  originally  fried,  the  circuit  of  Fig*  3*3  suffered 
from  instability  of  the  d-c  balance  and  this  instability  was 
traced  in  part  to  extreme  sensitivity  to  fluctuations  of  the 
"eater  voltage.  .An  electronically  regulated  a-c  supply  and 
SOS*  selection  of  tubes  have  improved  the  circuit  greatly  in 
this  respect.  However,  because  of  the  large  number  of  balance 
adjustments,  this  circuit  is  somewhat  unwieldy  to  use,  and  the 
i o fluctuations  in.  the  output  set  a definite  limit  to  this 
correlator 1 s -ability  to  detect  small  signals. 

The  assumptions  of  the  preceding  analysis  are  a little  too 
simple  since  i>  depends  to  a small  extent  on  e and  a depends 
to  a greater  extent  on  Feedback  systems  for  linearizing 

tne  iv  - e characteristic  (and  making  it  independent  of  e ) 
will  come  to  mind..  It  must  be  remembered,  however,  that  it  is 
impossible  to  feed  back  around  the  entire  multiplier.  It  is 
possible  that  a can  be  made  more  nearly  independent  of  e^  by 
feeding  some  of  the  signal  in  on  the  suppressor  grid. 

*Suarter-Dlfference-SQuare3"  Multipliers 

Another  method  of  multiplying  two  signals  is  the  quarter- 
difference-  squares  method,  which  is  simply  based  on  the  fact 
that  the  product  AB  * 1/4(A+B)2  - 1/4(A~B)2,  The  operation  of 
multiplication  is  thus  reduced  to  that  of  forming  the  sum  and 
the  difference  of  the  multiplicands,  and  squaring,  A block 
diagram  of  a correlator  based  on  this  principle  is  shown  in 
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Fig.  3.4. 

Because  of  curvature  of  the  plate  current-grid  voltage 
characteristic,  many  vacuum  tubes  operate  very  satisfactorily 
as  squarers*  For  example,  a twin-triode  squarer  can  be  built 
as  shown  in  Fig*  3' 5*.  We  again  assume  that  the  plate  currents 
in  the  individual  tubes  can  be  expressed  in  power  series  in 
the  signal  voltage  at  the  grid.  The  current  In  the  first  tube 
may  be  written; 


a0X4  allegl  4 a2legl  4 a31egl  4 a4l8gl  +* «***«* 


and  that  in  the  second, 

i 


a02+  a12eg2  * a22ag2  4 aJ?°g2  4 a42Sg2  4’ ' * • 


a02~  al2egl  4 a22egl  “ a32egl  4 a42egl 


* m 


where  e ^ and  are  the  signal  voltages  at  the  two  grids.  The 
out nut  voltage  is  proportional  to  the  aua  of  these  two  currents, 

■2  . 


h 4 b ’ (aoi‘ 


a02J  4 (aU*gl  ■ •la'gl5  4(a21*gl4  a22egl) 


4 (a31*ir  ba'gl5  4 (a4legl  4 a42*gi>  4---*--  • 

The  terms  In  the  first  parentheses  represent  simply  the  d~c  plate 
current,  while  those  in  the  second  can  be  made  zero  by  balancing 
the  amplitudes  of  the  signals  applied  to  the  grids*  The  terms 
in  the  third  Pair  of  parentheses  represent  the  desired  squared 
output.  The  terms  in  the  fourth  pair  are  small  and  nearly  bal- 
anced out,  and  those  In  the  fifth  and  higher  are  small  until  the 
grid  signals  become  very  large  (or  until  the  circuit  becomes 
overloaded*,  so  to  speak).  If,  however,  we  apply  thw  same  argu- 
ment given  in  the  section  above,  wo  see  that  it  is  not  n«c«a‘>ury 
to  have  perfect  (instantaneous)  squarers,  but  simply  a circuit 
whose  average  output  Is  proportional  to  the  square  of  the  Input, 

A single  tube  is  thus  adequate  to  perform  the  squaring  operation, 
if  the  average  output  of  the  multiplier  is  all  that  Is  required, 

A.  circuit  arrangement  for  a sing  1 o-trl ode  squarer  is  shown  in 
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Figo  3»6o  It  is  necessary  to  use  fixed  bias  with  such  a squarer, 
since  with  a cathode  bias  resistor,  the  degeneration  linearizes 
the  operation  of  the  tube  to  such  an  extent  that  it  loses  much 
of  its  square-law  sensitivity.  A graph  of  the  change  in  the 
average  plate  voltage  as  a function  of  the  rms  amplitude  of 
random  sinusoidal  grid  voltages  for  this  circuit  is  given  in 
Fig.  3c, 7-  Pentodes  may  also  be  used  in  the  same  way,  if  well- 
stabilized  voltages  are  applied  to  all  the  fixed-voltage 
electrodes.  A schematic  diagram  of  a pentode  squarer  using  a 
6SJ7  is  shown  in  Fig.  3° 8,  and  a graph  of  its  average  output 
voltage  as  a function  of  the  rms  input  voltage  is  shown  in 
Fig.  3*9. 

A circuit  diagram  of  a quarter-difference-squares  multi- 
plier using  the  two  halves  of  a 6SN7  twin  triode  as  tho  squarers 
is  shown  in  Fig.  3«10.  Self -bias  is  used,  but  the  resistive  bias 
network  Is  by- passed  by  a large  capacitor,  so  that  cathode-circuit 
degeneration  cannot  linearize  the  tube  characteristics.  A d-c 
balance  potentiometer  in  the  cathode  circuit  allows  one  to  set 
the  no-signal  output  at  zero.  Two  ganged  potentiometers  in 
the  grid  circuits  allow  adjustment  of  the  signal  amplitudes  at 
the  grids  to  compensate  for  possible  inequality  in  the  square- 
law  sensitivities  of  the  two  halves  of  the  tube.  This  control 
is  adjusted  so  that  the  output  remains  zero  when  a signal  is 
applied  to  only  one  of  the  inputs.  The  inputs  should  not  ex- 
ceed 3 v rms.  An  RC  averaging  network  is  shown  at  the  output ; 
in  adjusting  this  network  to  a particular  time-constant,  account 
must  be  taken  of  the  non-zero  source  impedance  at  the  plate  cir- 
cuits of  the  squarers.  We  have  found  it  easiest  to  measure  this 
(resistive)  impedance  using  a simple  resistance  voltage-divider. 
Circuits  of  this  type,  but  using  fixed  bias  derived  from  a 
battery,  exhibit  a considerably  greater  zero-drift  stability 
than  the  6AS6  multipliers  discussed  in  the  previous  section, 
and  the  circuit  described  above,  which  uses  a common  cathode 
bias  circuit,  is  even  a little  more  stable  in  this  respect. 

Because  of  charging  of  the  capacitor  in  the  cathode  circuit, 
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the  operating  points  of  the  squarer  tubes  change  slightly 
with  the  amplitude  of  the  input  signals . This  change  was 
found  to  be  very  small,  however,  and  apparently  has  negli- 
gible effect  on  the  operation  of  the  correlator- 

A solution  to  the  problem  of  the  drift  in  the  output 
was  sought  in  the  use  of  synchronous  switches  or  choppers 
which  were  used  to  interchange  the  two  squaring  tubes  period- 
ically- The  choppers  serve  to  convert  any  d-c  unbalance  which 
may  arise  in  the  squarers  to  an  a-c  voltage  whose  average  value 
is  zero,  A block  diagram  illustrating  the  application  of  chop- 
pers to  the  correlator  of  Pig,  3,10  is  shown  in  Pig.  3.11.  The 
choppers  used  were  double-pole  double- throw,  break-before-make 
Type  258  AC-DC  Choppers.*  They  are  powered  by  the  6.3-v, 

60-cps  heater  supply.  The  two  switches  in  these  choppers  are 
well  synchronized,  and  are  open  for  about  1 millisecond  of 
their  8 1/3-millisecond  period.  The  alternate  periods  of 
contact  in  the  chopper  are  factory-adjusted  to  be  equal  within 
5 per  cent,  but  can  be  balanced  more  accurately  by  adjusting 
the  amplitude  of  the  driving  voltage.  Measurements  of  the 
output  signal- to-noise  ratio  were  made  by  the  method  to  be 
described  below  for  a correlator  of  this  type.  They  indicate 
that  for  random  inputs  the  output  signal- to-noise  ratio  is  not 
more  than  1 db  less  for  a correlator  with  choppers  than  for 
one  without  choppers.  In  addition,  the  output  drift  is  very 
substantially  reduced.  Unfortunately,  if  there  is  in  the  in- 
put a sinusoidal  wave  of  a frequency  which  is  a near  multiple 
of  60  cps,  there  appear  "beats”  of  fairly  large  amplitude  in 
the  output,  presumably  due  to  the  imperfect  action  of  the  syn- 
chronous switches  (the  fact  that  they  are  open  for  about  1/8 
of  their  period).  If  a switch  could  be  built  which  would  in- 
staneously  change  from  one  position  to  the  other  this  beat 
phenomenon  would  disappear,  and  there  would  be  no  difference 
between  a correlator  equipped  with  such  perfect  choppers  and 

♦Manufactured  by  Stevens -Arnold,  Inc. , South  Boston,  Massachusetts. 
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Fig.  5.7.  Graph  of  the  change  in  the  output  voltage  as  a function  of 
the  rms  input  amplitude  for  the  squarer-averager  of  Fig.  5.6.  Circles 
axe  measured  points  for  a sinusoidal  input,  crosses  are  measured  points 
for  a normal  random  noise  input.  The  straight  line  is  the  perfect 
square-lav  characteristic. 
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Pig.  3.9.  Graph  of  the  change  in  tha  uuipiii.  vnltngn  a a a f unof  Ion  < > (' 
the  m»  .tnpai  n/npXit-ude  for  the  fi-juarer'-avarnKar  of  f l £ . 3,H.  CHrplew 
are  mae, oared  poinbo  for  a uiruau  IdtU  input,  uri  .««<■»«  a iv  niw»*wr**d  point  w 
for  a norma  1 random  nolna  Input,  The  ni  might  Huh  1m  Him  purtVnt 
sq  oar  e-law  oharao  t a r 1 0 f.  1 n . 
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Fig.  *.11.  Block  dlagraa  showing  the  asthod  of  applying  chopper* 
to  tha  ■ultipller-aTerager  of  Fig.  J.10, 
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one  without,  except  that  the  drift  noise  would  be  removed.,  It 
appears  that  the  amplitude  of  the  chopper  driving  voltage  must 
be  well  regulated  in  order-  to  prevent  zero  drift  due  to  changes 
in  the  lengths  of  alternate  periods  of  contact. 

If  one  can  tolerate  imperfect  choppers,  that  is,  if  one 
is  performing  cross-correlations  of  purely  random  functions, 
one  can  use  a " single-channel"  correlator  in  which  only  one  square- 
law  device  is  used,  being  alternately  switched  back  and 
forth  from  the  sum  channel  to  the  difference  channel.  A 
schematic  diagram  of  such  a correlator  is  shown  in  Fig.  3*12, 
where  a 6SJ7  pentode  squarer  is  used.  A little  greater  sta- 
bility of  the  output  is  expected  here,  since  only  one  chopper 
is  used  instead  of  two,  and  it  is  only  necessary  to  maintain 
the  symmetry  of  operation  of  one  chopper.  An  output  d-c  bal- 
ance control  is  provided  in  this  circuit,  although  it  would 
not  be  necessary  with  perfectly  matched  components  in  the 
plate  circuits,  and  a perfectly  symmetrical  chopper.  Be- 
cause of  the  much  greater  square-law  sensitivity  of  the 
6SJ7,  this  correlator  has  a much  greater  output  voltage  for 
a given  input  amplitude  than  the  correlator  of  Fig.  3.10. 

Reasonably  accurate  square-law  rectifiers  can  be  con- 
structed of  contact  rectifiers  such  as  the  1N34  germanium 
diode.  One  method  is  to  use  a large  number  of  rectifiers, 
each  biased  at  a different  voltage,  so  that  each  starts  con- 
ducting at  a different  input  amplitude.  By  means  of  suitable 
resistive  combining  networks  any  monotonic  characteristic  can 
be  approximated.  Because  of  possible  variations  in  the 
characteristics  of  the  individual  rectifiers,  it  is  necessary 
to  use  fairly  large  bias  voltages  so  that  the  rectifiers  are 
essentially  nothing  more  than  switches.  This,  in  turn,  re- 
quires that  the  input  voltage  be  of  a fairly  large  amplitude, 
which  may  require  special  amplifiers.  However,  good  accuracy 
is  claimed  for  this  method,  eleven  diodes  being  required  to 
match  a square-law  curve  for  inputs  from  0 to  100  v with 
1 per  cent  accuracy. ^ Another  method  is  simply  to  make  use 


TM  27 


“40” 


of  the  fact  that  the  characteristic  of  the  contact  rectifier, 
is,  for  small  signals,  a good  approximation  to  a square  law. 
Because  it  is  necessary  to  keep  the  voltages  across  the 
individual  diodes  low,  it  is  necessary  to  connect  many  diodes 
in  series,  to  obtain  square-law  operation  at  convenient  input 
voltage  levels, ^ Figure  3*13  is  a schematic  diagram  of  a 
•iquarer  of  this  type.  When  it  is  connected  for  full-wave 
operation,  as  shown,  it  is  a perfect  squarer,  whose  output 
is  proportional  to  the  square  of  the  input,  If  only  +He 
average  square  is  required,  it  is  only  necessary  to  provide 
half-wave  operation.  In  Fig.  3*14  are  shown  curves  of  average 
output  voltage  as  a function  of  the  rms  input  voltage  for  the 
squater  of  Fig..  ’.13,  These  curves  show  the  effect  of  chang- 
ing the  load  resistance  R while  keeping  the  number  of  recti- 
fiers (11  in  this  case)  constant.  In  Fig.  3,13  are  shown 
curves  illustrating  the  effect  of  changing  th*  number  of 
rectifiers  while  keeping  the  lead  resistance  fixed.  These 
turves  show  that  if  the  load  resist or  is  too  small,  there  is 
a departure  from  the  true  square-law  our/e  at  tn»  small  input, 
voltage  end,  while  if  it  is  too  large  „ *h»  act  mi  operation  de- 
parts from  true  square-law  at  th*  high  ir.put  .••■Itige  end.  The 
li'-'las  used  in  these  tests  w*r*  seler  te»*  to  have  nearly  equal 
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tivity, this  unit  has  been  much  useful  t*»  na  than  other 

correlators,  but  it  does  have  the  great  advantages  of  having 
no  zero  drift,  and  requiring  no  power  of  any  kind.  We  are 
hopeful  that  it  may  be  possible  to  devise  a network  of  the** 
contact  rectifiers  which  will  accurately  reproduce  a square- 
law  dynamic  characteristic  over  a wider  rang** 


Measurements  of  Correlator  Signal- -to  F ->  1 se _Ra r 1 o 

Measurements  of  the  signal  to- noi.se  rati-:  at  the  output  of 
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Fig.  J.Xt.  Graph  ox  the  average  ou^ut  voltngo  of  the  circuit  of  F tg. 
with  11  dlodee  In  each  chain  for  varloua  valuaa  or  Ilia  load  reatet  or  aa  a 
function  of  the  runs  value  of  a elnueofdai  Input  voltage. 
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Fig.  *.15.  Graph  of  the  average  oalpai  voltage,  of  1 he  circuit  of  Fig,, 
with  a lGjjjj-ohjn  load  real  a to  r and  various  numbers  ol'  diodes  In  each 
chain  as  a function  of  the  ran  value  of  a alrunoldal  input  voltage. 
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a correlator  are  of  interest  not  only  in  checking  the  theory, 
but  also  in  evaluating  the  performance  of  the  multiplier. 
Noise  in  the  output  can  be  divided  into  two  categories: 
the  fluctuation  noise  which  always  appears  when  random  volt- 
ages are  applied  to  the  Inputs,  and  other  steady  or  fluctuat- 
ing voltages  which  are  present  because  of  improper  operation 
of  the  multiplier.  The  latter  may  consist  of 


and 


(1)  d-c  balance  instability  or  drift, 

(2)  d-c  voltages  which  may  appear  because  of 
improper  operation  of  the  multiplier  (de- 
parture from  square- law  characteristics, 
imperfect  sum-and-difference  network,  etc.), 

(3)  self-noise  (thermal  or  shot  noise), 

(4)  periodic  noise  due  to  choppers. 


The  signals  were  measured  and  noises  of  the  first  two  kinds 
were  evaluated  by  recording  the  output  of  the  correlator  on  a 

7 

level  recorder.  The  fluctuation  noise  and  chopper  noise  were 
measured  with  the  low-frequency  square-law  voltmeter  described 
below.  Self-noise  was  proved  negligible  for  the  simple  corre- 
lators tested. 


It  is  reasonable  to  assume  that  drift  noise  la  the  output 
of  a correlator  exists  in  a frequency  band  much  smaller  than 
the  band-pass  of  the  RC  averager.  Neglecting  this  very-low- 
frequency  drift  noise,  it  can  be  shown  that  the  spectrum  of  the 
input  to  the  averager  may  be  assumed  uniform  with  little  error 
if  the  bandwidth  of  the  correlator  input  signals  is  wide  com- 
pared to  the  band- pass  of  the  averager.  We  therefore  evaluate 
the  output  noise  by  measuring  that  above  1 cps  in  frequency  and 
extrapolating  to  estimate  the  total  noise  output.  Since  drift 
noise  occurs  at  frequencies  much  lower  than  1 cps,  it  does  not 
disturb  this  measurement. 

The  circuit  of  the  noise  meter  constructed  for  this 
purpose  is  shown  in  Fig.  3»17.  Because  the  output  of  most  of 
the  correlators  we  have  built  is  not  push-pull,  the  first  two 
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stages  effectively  take  the  difference  of  the  voltages  at  the 
two  input  terminals  and  convert  this  difference  into  a true 
push-pull  signal  which  is  applied  to  the  grids  of  a 12AU7 
squarer  of  the  form  of  that  shown  in  Pig.  3*5*  The  meter  thus 
reads  the  true  mean  square  of  the  input,.  All  the  correlators 
which  were  tested  were  equipped  with  RC  averagers  each  of 
which  consisted  of  a 100, 000-ohm  resistor  and  a l-oicrofarad 
capacitor*  It  can  be  shown  that  the  input  circuits  of  this 
meter  do  not  load  these  averaging  networks  enough  to  make  a 
significant  change  in  the  effective  time  constant  of  the 
averager.  Because  of  the  extreme  sensitivity  of  a voltmeter 
circuit  of  this  type  to  supply  voltage  changes  (both  plate 
and  heater),  the  unit  is  operated  from  an  a-e  line  voltage 
regulator.  Long  warm-up  and  freemen!  zero  checks  are  neces- 
sary for  accurate  operation.  The  meter  is  calibrated  by 
measurement  of  a 30-50  ops  sinusoid  of  known  amplitude.  A 
condenser  across  the  grid  circuits  of  the  third  pair  of  tubes 
limits  the  response  of  the  meter  at  high  frequencies  (3  db 
i--.tr.  zl  160  cos)  to  reduce  the  effects  of  self-noise  in  the 
•v.-t-r.  The  tire  constant  of  the  meter  averager  is  adjusts'  le 
from  0.1  second  to  100  seconds  so  that  it  can  be  made  appropri- 
ate for  the  particular  .-.easuri-aent  being  made* 

This  -eter  v.-anurea  the  noi  qe  above  1 os  in  the  output 
.f  toe  correlator.  The  extrapolation  to  the  total  noise  out- 
rat  (not  including  drift  noise,  of  course)  rum  be  carried  on t 

in  terms  of  the  equivalent  rectangular  paas-bands  of  the  aver- 
ager and  the  noise  meter.  The  intensity -frequency  characteris- 
tic of  the  RC  averager  Is  0 

col 


2 2 
< jJ  -Hjj  c 

o 


where  coQ  = 1/RC.  The  width  of  a rectangular  band  (with  unity 
response)  which  would  pass  the  same  power  is  then 


oo  .,2 ... 

/u>  Cu) 

Q Ui  (i) 

o 


= oast 
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cycles . 
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the  noise  meter  has  three  RC  high-pass  coupling  networks  which 
act  independently  on  the  frequency  responutu  Its  intensity* 
frequency  characteristic  Is  then 


where  s*k  * 1/R^C^,  the  cut-off  frequency  of  one  of  the  three 
coupling  networks,,  so  the  cut-off  frequency  of  the  equivalent 
rectangular  high- pass  filter  is 


The  reading  of  the  square-law  meter  must  then  be  multiplied  by 


1-1.87  21 

2 ~6  u> 


to  obtain  the  mean-square  value  of  the  output  noise. 

Output  signal- to-noise  ratios  have  been  measured  for  the 
correlators  of  Flgs<  3.10,  3 ,11.,  and  3,12,  Input  background 
noises  and  a random  (noise)  signal  were  derived  from  gas- tube 
noise  generators  and  combined  in  resistive  adding  networks. 

The  input  signal- to-nolse  ratios  were  measured  with  a Ballantine 
Model  j,00  Electronic  Voltmeter.*  The  input  signals  were  passed 
through  an  amplifier  which  had  a single- tuned-circuit  filter  with 
a center  frequency  of  3300  cps  and  adjustable  Q,  The  correlator 
time  constants  were  always  adjusted  to  be  0,1  second  as  accurately 
as  possible.  The  theoretical  output  signal- to-noise  ratios  were 
computed  from  the  formulas  in  Table  2,1  from  the  above  data  and 

♦It  has  been  found  that  when  the  Ballantine  voltmeter  is  used 
to  measure  the  normal  random  noise  used  in  these  experiments,, 

1 db  must  be  added  to  the  meter  reading  to  obtain  the  true  rms 
value.  This  correction  is  constant  over  the  entire  scale. 
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the  measured  input  signal-to-noise  ratio.  The  correction  fac- 
tor for  the  low- frequency  square-law  voltmeter  for  the  above 
averager  time  constant  is  0,4  db.  The  results  of  these  meas- 
urements are  compared  with  the  theoretically  predicted  values 
In  Table  3,1, 

Because  of  the  inherent  difficulties  of  noise  measurements 
occasioned  by  the  requirements  of  long  averaging  time,  and  be- 
cause of  zero  drift  in  the  low-frequency  voltmeter,  the 
accuracy  of  these  measurements  is  probably  not  better  than 
*1,5  db.  With  this  in  mind,  the  data  in  Table  3-1  show  good 
agreement  between  theory  and  experiments  The  last  entry  in 
the  table  (for  the  correlator  of  Pig.  3»12)  which  indicates  a 
very  ooor  output  signal-to-noise  ratio,  is  included  simply  as 
a reminder  that  with  that  circuit  there  is  a comparatively 
large  60-cps  component  in  the  output  because  of  the  chopper. 

The  fundamental  and  several  harmonics  of  this  frequency  are 
within  the  pass-band  of  the  low-frequency  voltmeter,  so  that, 
even  with  no  input  signals,  the  voltmeter  indicates  a large 
output"nolse» " Comparison  of  fluctuation  amplitudes  on  graphs 
made  by  the  recorder,  whose  pen-drive  system  cannot  respond  to 
the  60-cps  voltage,  Indicates  that  there  is,  as  one  would 
expect,  no  difference  in  the  output  signal-to-noise  ratio 
for  this  correlator  and  an  "honest”  one,  if  the  chopper 
"noise"  is  neglected. 
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IV 

SIGNAL- TO -NOISE  RATIO  AT  THE  OUTPUT  OF  A DETECTOR 

A detector  is  assumed  to  consist  of  h rectifier  end  an 
averaging  network  or  filter*  It  is  of  interest  to  compute  out- 
put slgnal-to-noise  ratios  from  the  detector  both  for  comparison 
with  those  for  correlators,  and  for  estimating  output  *ifrj*i-t©~ 
noise  ratio*  for  circuits  which  are  similar  in  operation  to  cor- 
relators but  somewhat  easier  to  construct.  These  correlator- 
type  circuits  will  be  discussed  in  Chapter  V. 

Considerable  attention  has  been  given  in  the  literature  to 

t 

the  problem  of  the  signal-to-noise  ratio  after  a detector.  The 
problem  solved  here  is  one  which  can  be  handled  by  fairly  straight.- 
forward  mathematical  techniques,  He  limit  our  consideration  to 
tne  case  of  a noise  signal  in  a noise  background,  where  the  sig- 
nal and  the  noise  have  the  same  spectral  distribution,  to  the 
case  of  the  full-wave  detector ,♦  and  to  the  case  of  relatively 
long  averaging  tire  and  very  small  input  signal- tc~noise  ratios. 

The  problem  of  detection  reduces  to  the  question  of  whether  the 
increment  in  the  average  output  of  the  detector  due  to  the  sig- 
nal can  be  seen  in  the  presence  of  the  output  noise.  As  long 
as  the  innut  signal -to -noise  ratio  is  very  small  .,  these  resul  ts 
should  be  useful  for  any  type  cl'  input  signal , because  the  proba- 
bility density  for  the  sum  of  a gaussian  noise  and  any  small 
signal  is  approximately  the  same  as  that  i'oi  a gaussian  noise 
caving  a mean-square  amplitude  equal  to  the  sum  of  the  mean- 
square  amplitudes  of  the  noise  and  the  signal, 

, signal- ladiaUs  .flatls 

Let  us  suppose  that  the  instantaneous  voltage  output  of 
a rectifier  circuit  is  where  v(t)  is  the  instantaneous 

input  voltage.  We  assume  that  v(  t)  is  gausslarxly  distributed 

^ * ^ 

A more  mathematically  elegant  solution  of  this  problem  by 
Middleton  and  Stone  is  included  herewith  as  Appendix  III, 
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and  has  the  mean-square  N,  For  a full-wave  power  law  defeca- 
tor 

f(v)  * |V|V  „ (4,1) 

Then  the  average  output  of  the  detector  is 


TTtT  - 


jv|v  e“v  /2N  dv 


€L 


v e f **  dv 


* IT 


v/2 


«*7z  , 7 

(2)* 


v even} 


(4.2) 


v/2 


(^5^)  i , v odd. 


u 


If  the  output  is  averaged  by  a network  whose  weighting  func- 
tion is  gCt),  the  output  of  the  averaging  network  is  (Bq<  (2.1)) 


or* 

r<t)  * f g(t')  f(v( t-t* )3dt * , 


and  its 
?2{t)  * 


mean 


square  Is 

g( t*)  f(v(t-t')3dtt) 


g(t!)  fCv(t-t,)3dt* ) 


/• 


l'(t')  g(t") 

'o  'o 

Let  v(t"t*)  = x and  v(t  t") 

.CD  00 


F2(t)  = 


g(t’)  g(t»') 


f Cv(t- t ' ) ]f (v( t- ttt) 3 dt' dt 


* y.  Then 

f(x)  f(y)  dt*  dt 


We  evaluate  this  by  means  of  the  -Joint  probabi  lity  density  for 
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the  gauss ianly  distributed  variables  x and  y, 


P(x»y*5)  ~ 2rrN  4/T~~VT?: 


2Nci-r(p] 


, (4.3) 


where  P(£)  is  the  normalized  autocorrelation  function  of  x (or 
y).  P(x,y,^)  dxdy  is  the  probability  that  the  voltage  lies  be- 
tween x and  (x  + dx)  at  some  time  t arid  between  y and  (y  + dy) 
at  the  time  t * \ . Thus 


7 


F*<t)  » J J f f g(t‘)  g(t")  f(x)  f (y)  P(x,y,t"-t*)dxdydt*dt* 
vO  -OO  -00 

We  make  the  change  of  variables  (cf*  Chap.  II) f 

t*  - t»  «|  and  t"  ♦ t'  * H 

perform  the  integration  with  respect  to  *1,  and  find  that 


PTt)  * 


7 7 »<?)  f<*> 


-00  -00 


f(y)  P(x,y,f)  dxdydC, 


(4.4) 


where  w(|)  is  the  transformed  weighting  function  of  the  averaging 
network.  To  evaluate  the  integral  In  Eq.  (4.4),  we  note  that 
Eq.  (4.3)  can  be  written 


e 


and  that,  hy  Eq,  (4.1), 


f(x)  f ( y)  * | xy j , 


which  can  be  written 


*rl 


Then 

F2(t)  * J J I w ($) 


7 


2 

4 


J&jL2-.  lir.il2. 

4 


TT 


-00  - 00  -00 
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We  now  let 


dx  dy  a? 

2 NVl-p2(?) 


4n[i-pC5)  3 


u and 


/4NU+p(^)] 


whence 


2N/l-p2(|) 


du  dv, 


F2(t) 


* 11  ] 

* OD  * 00  -*/QD 


w(5)  u2[l-p(5>]  - v2[l+p(5)3 


2 _2 

e~u  e-v  du  dv  d?< 


(4.5) 


We  now  let 


2 2 2 

u + v * r,  u = r cos  ©,  ▼ » r sin  9, 


and  Eq»  (4.5)  becones 


F2(t) 


oo.  2rr  oo 


*/  / / 

* OD  ^0  J 0 


2 

w(£)  cos  29  - p(£)  v r2v4J  e”r  dr  d9  d|. 


We  perform  the  r- integration  and  set  2©  = 6* 

Then 


F2( t)  = Nvv’.  f w(£)  i-  I cos  6 - p(|)  drf  d|  . (4.6) 


We  have  found  it  difficult  to  evaluate  the  integral 


I * i- 

x 2rr 


cos  6 - p(|)  drf  (4.7) 


i 


for  arbitrary  values  of  v,  although  it  must  represent  a continuous 
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function  of  v for  0 < v < jo.  It  is  possible,  however,  to 
evaluate  it  for  a few  specific  values  of  v* 


I 3 i 


When  v » 1, 
cos^pCp 


[cos  4 - p(|)3 


1 > 

tp(|)  - cos  4)d4 

cos^pQp 


• £tp(J)  Sin'1  Pi?)  +/l  - ^(5)3. 

We  substitute  the  following  series  expansions? 


P(5)  sln“X  PCT> 


yx  - p2(i>  - 


i 


>2k*2 


*Ifnq 

2S7l  ’ 


2k +2  0 


Then,  for  v * 1, 

t .2*2 T\‘~7  jLaot 

1 " n / _i  «2Kffc,  <2 

w 2 (k,) 

and  Eq-  (4,6)  is 


1 2k+2(J) 

(2k*l)  (2k>2)  p ’ 


f2(t) 


Li  22k?!‘s  TanTTIkJsT  p2k*2(|)i». 

k«o  2 U*} 


7; 


(4.6) 


If  v in  Eq,  (4.7)  is  an  even  integer, 


1 * / ^cos  ^ ^ 


lir^* 

2rr 


2rr)L 


<-1>B  T7itrnT 


V-|fiy  _D9/ 
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This  integral  amounts  simply  to  averaging  over  a period  of 
He  can  write  


cos^rf 


,,-iv-m 

±jdi 

2 


and,  after  expanding  by  the  binomial  theorem,  we  see  that  the 
only  term  with  nonvanishing  average  is  the  term  independent  of 
6.  That  is, 


cos 


v-m 


v-m(v^)t2  ’ 


* 0,  (v-m)  odd* 


(v-m)  even. 


(4.9) 


Then,  substituting  2£  for  m,  in  order  to  retain  only  the  terms 
for  even  values  of  m (and  even  values  of  (v-m)), we  have 


'!  eOhll 


jlL 


(20!  O'.2  2 Vt|)!2 

and,  for  v even,  £q.  (4.6)  is 
v 2 v 2 

” ' _ + N »l2  

<2  .v  l* — 4.  Cpt'lKX  ~t)i2  , 

'CO 


F2(t) 

'2 


2V(*)!2  2v 


(4.10) 


If  there  is  added  to  the  input  background  noise”  a small 
noise  signal  of  mean-square  amplitude  S,  there  will  be  an  incre- 
mental increase  in  the  average  output.  From  Eqs.  (4.2),  this 
increment  (which  we  call  the  output  signal)  is,  for  v ■ 1, 

-jWm  yp’c  vTfs75  - 1]  s 


S « 


and  for  v * 2,  4,  6,  8,  ....  , 


r vi  i 

_2V^2(|)'_ 

,v/2_  -v/2 


- Nv-/ 


2v/2(-^! 


\ (§),  S « If. 
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The  output  noise  can  be  measured  as  the  difference  between  the 
mean  square  of  the  output  and  the  square  of  the  average  output. 
Then  the  mean-square  output  signal- to-noise  ratio  is,  for  v = 1, 
and  (S/H)in«  1,  (from  Eq.  (4.8)), 


* (4.11) 


(S/N) 


out 


(v/2) 


.2 


v/2 

& 


til  (s/n4 


a Dia  -t).’2  J 


J' 

- 00 


(4.12) 


w ())p2t(^)  d5 


Evaluation  for  Specific _Exagple3 

The  output  signal- to-noise  ratio  depends  upon  the  correlation 
function  p(J)  of  the  input  noise  (or  its  spectrum)  and  upon  the 
transformed  weighting  function  of  the  averaging  filter  (or  its 
frequency  response).  The  integrals  to  be  evaluated  are  in  each 
case  of  the  same  form, 

w(j)  paC'(3)  .d$  . (4.13) 


This  integral  can  be  readily  evaluated  for  at  least  two  forms 
of  input  spectra,  for  an  RC  averaging  network,  subject  to  the 
assumptions  that  the  averaging  time  is  very  long,  and  that  the 
input  bandwidth  is  at  least  moderately  narrow.  We  use  the 
transformed  weighting  function  for  an  RC  averager,  from  Eq. 
(2.9), 

“ 2RC  e 


Ao  Tnped  Circuit  Spectrum;  The  normalized  autocorrelation 
function  of  "white"  noise  after  passage  through  a moderately 
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high-Q  single -timed  circuit  filter,  of  center  frequency  co0/2tt 
and  half- bandwidth  a>p/2fT  is  (see  Appendix  II) 

p(r)  * e cos  ojvt  * 

Then,  for  this  case,  Eq.  (4,.  13)  is 

r.&  fr  W™ 

J(X> 


-L 

RC 


QD 

/. 


e 


Cfe  + 2^P3^ 


cos2^»0^ 


It  we  assume  that  u>0  »Wy,  we  can  replace  the  cosine 
term  with  its  average  value  which  we  found  in  Eqs„  (4.9) J 


L2L1L 

wrr 


p 


RC  7r  {ll)2 


rl_ 

LRC 


— Ufcli . 

C(j)2[l  + 2'tu)pRC] 


If  we  assume  now  that  RC  » ^-  , which  simply  corresponds  to 

p 

thorough  filtering,  we  have 


J 


(20-' 

2Z\ll)2  2-tyRC 


Substituting  this  value  in  Eqs,  (4,11)  and  (4,12)  gives  the 
mean-square  output  signal-to-noise  ratio  for  the  timed-circuit 
input  spectrum^  for  v * 1, 


(S/N>out 


(S/K)ln 


CO 

(2k)  J 

2 i 

/L 

k=0 

22k(k,')2 

(k+1)3 

- aopRC  (s/N)2n  - o„965  ? (s/n) ln  « 1 


and  for 


v - 2 , 4,  6 , 8 , 


ft  • O O J 
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cs/N)out » 2^msmln  -g-teJaL 


z 


5 ( S/N)  ln  «1. 


i=l  -l  ) ! ' ( V<  ) ' 


Values  of 


(S/N) 


out 


i,rBC(S/N)ln 


computed  from  the  above  for  various 


values  of  v are  tabulated  in  Table  4,1= 


Power  Law  of 

table  4,al 

Tuned-Circuit  Spectrum 

Relative  Output 

Relative  Output 

Full -Wave  Detector 

S/N  Ratio 

S/N  Ratio 

1 

,965 

-0.12  db 

2 

1.000 

0.00 

4 

.889 

-0.48 

6 

o 

lr\ 

e 

-1.84 

3 

.405 

-3.90 

10 

< 212 

-6.53 

J&.  Rectangular  Spectrum;  The  normalized  autocorrelation  function 
of  noise  whose  spectrum  is  constant  between  Coo Q ~6u>)  and  (co0  +Ao>  ) 
and  zero  elsewhere  is 


p(r)  * cos  wQr 


Then  J (Eq,  (4.13))  is 


J „ j-.M 

J 2RC 


J.*  If/BB  cos^ 


We  again  replace  the  cosine  term  by  its  average  value  as  before , 
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and  assume  that  RC  » l 


^ , so  that  throughout  the  range  where 

the  integrand  is  appreciably  different  from  zero, 


r 151/Ho 


Then 


J * ^ -J&  U 

« \ 


2RC 


2 / 


2^(11)' 


The  integral 


K*.  - / 

- CD 


which  can  be  evaluated  by  contour  integration,  has  the  values 
given  be lows 


L 

5t 

1 

tt 

2 

0 6667  TT 

3 

,5500  TT 

4 

. 4794  TT 

5 

„4304  tt 

By  substituting  the  values  of  J = ' 2Z^^2 — ln  Eqs' 

(4,11)  and  (4.12),  we  find,  for  v * 1, 


(S/N) 


out 


las 1 


l2Kjtn 


d2]c  ki  (k+l)|l  n 
2RC  (Aw)  1 (S/N)Jn  • 0,952 


and,  for  v = 2,  49  6,  8,  , 


Curves  of  relative  output  signal- to~noise  ratio  are  plotted 
in  Fig.  4-0 1 for  these  two  input  spectra.  For  both  input  spectra 
there  is  a slightly  better  output  signal-to~noise  ratio  for  the 
square-law  detector,  although  the  linear  detector  is  not  appreci- 
ably worse.  The  slight  superiority  of  the  square -law  detector 
is  also  predicted  by  Mayer^  although  his  results  for  the  half- 
wave detector  are  apparently  in  error.  He  predicts  that  the 
half-wave  detector  should  be  considerably  inferior  to  the  full- 
wave  detector 5 we,  and  others,  feel  that,  for  long  averaging 
times,  there  should  be  no  difference.  Burgess^-  finds  that  the 
square-law  detector  has  a similar  slight  superiority  with 
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respect  to  output  signal-to-noise  ratio  in  the  detection  of  a, 
sinusoid  in  noise 5 although  his  work  is  based  on  different 
assumptions  concerning  the  averaging  time. 
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OTHER  CORRELATOR-TYPE  CIRCUITS 

Two  other  circuits  which  behave  in  much  the  same  way  as  a 
multiplier-averager  have  been,  analyzed.  Although  these  cir- 
cuits do  not  produce  quite  as  high  output  signal-to-noise  ratios 
as  a multiplier-averager,  they  do  have  characteristics  which 
may  be  advantageous  in  certain  uses,  and  one  of  the*  is  consid- 
erably easier  to  construct  and  operate.  The  first  to  be  dis- 
cussed is  the  polarity  coincidence  correlator,  which  sea sure s 
the  degree  of  correlation  of  two  signals  by  determining  the 
fraction  of  time  that  the  instantaneous  polarities  of  the  two 
signals  are  the  sane;  the  other,  the  linear  rectifier  corre- 
lator, is  the  same  as  the  multiplier-averager  shown  In  Fig. 

3-*  with  the  square-law  rectifiers  replaced  with  linear 
rectifiers,  The  first  of  these  Is  thus  seen  to  be  at  least 
similar  in:  operation  to  a conventional  phase  meter,  and  the 
second  Is  simply  a form  of  the  coherent  detector, 

■Ifrs-  £aiail£si£ s&mlteMa. ...  iaiai 

The  polarity  coincidence  correlator  is  an  electronic 
circuit  with  two  inputs,  whose  output,  before  averaging,  Is 
*1  v when  the  instantaneous  polarities  of  the  two  inputs  are 
the  same , and  -1  v when  the  inputs  have  opposite  polarities. 

This  operation  can  be  realized  'by  severely  clipping  both  in- 
puts and  applying  the  resultant  rectangular  voltage  waves  to 
any  of  a variety  of  coincidence  circuits  If  the  two  Inputs 
are  Incoherent  random  noisef,  the  average  output  will  be  zero, 
since  the  two  inputs  will  be  of  the  opposite  polarity  as  often 
as  they  are  of  the  same  polarity.  If  the  inputs  are  Identical 
the  output  will  be  +1  regardless  of  the  input  signal  amplitudes. 
The  average  output  depends  on  the  degree  of  coherence  of  the  two 
Incut  signals  .rather  than  on  their  amplitudes,  since  all  am  pi  I 
tude  information  is  removed  in  the  clipping. 

The  average  output  of  the  polarity  coincidence  correlator 
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is  simply  the  probability  that  the  instantaneous  signs  of 
the  two  inputs  are  the  same  less  the  probability  that  the 
instantaneous  signs  are  different.  We  can  compute  this 
probability  only  if  we  know  the  joint  probability  density 
for  the  two  input  functions „ We  assume  here  that  both 
inputs  are  gaussian  random  functions,  and  our  results  here 
are  only  valid  for  that  case.  The  probability  that  the 
signs  of  both  inputs  are  positive  is 


P * 


P2(x,y,t)tSx(\y1 


where  x(t)  Is  one  input  function, 


y(t“0  Is  the  other  input  function, 


and  P2(x,y,£)  is  the  joint  probability  density  for  the 
gaussian  random  functions  x and  y (Eq0  (4*3) )„  In  terms 
of  p(t),  the  normalized  correlation  function  of  x(t)  and 
y(t), 


P 


_1_ 


2ttN 


_JL_. 

✓l'-P^(r) 


*i  4 .y2  ,.“  2*yp(f) 

2N[l~p2(tf)3 


dxdy, 


where  N is  the  mean  square  of  x(t)  and  y(t)0  Paralleling  the 
procedure  of  Chapter  IV,  following  Eqc.  (4*4),  we  write  the 
above  as 


P 


2rrN^“ 


■P2(*) 


and  make  the  change  of  variables 


V4N(l+p(«)] 


u 


and 


JLZ-JE 


V^NCi-per)) 
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p - * J J 

e**(u  +V  ) dvdU( 

o J 

We  then  substitute 

p p . 2 

p 2 2 

r * u + v 5 u * r cos  ©^  v * r sin  0^ 


The  probability  that  the  signs  of  both  inputs  will  be  negative 
will  also  be  p,  so  the  probability  that  the  instantaneous  signs 
of  both  inputs  are  the  same  Is 

2p  - \ + ^ sin^pCtO, 

The  probability  that  the  signs  of  the  two  input  functions  are 
different  must  then  be 

1 - 2p  * | - £ sin"1p(c'). 

The  average  output  of  the  polarity  coincidence  correlator  is 
the  difference  of  these  two  probabilities  or 

fit)  = £ sin“1p('C  ) . (5a) 

The  average  output  thus  depends  only  on  the  normalized  cross- 
correlation of  the  two  input  functions.  Equation  (5a)  is 
plotted  in  Pig.  5a  for  the  range  p('t')  > 0^  F(t)  is  clearly 
an  odd  function  of  p(C)o 

If  one  input  function  is  Cn-^(t)  + s(t)3  and  the  other  is 


<? 

) 


Fig.  5.1.  Average  output  voltage  of  the  polarity  coincidence 
correlator  as  a function  of  the  normalized  crosacorrelation  of 
the  input  functions.  For  negative  values  of  f>{f)  the  average 
output  is  negative;  it  is  an  odd  function  of  p(^). 
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[n,,(t)  + s(t)],  where  n-^Ct),  n2(t)  and  s(t)  are  incoherent 
random  functions,  and  if  the  mean  square  of  n1(t)  and  n^Ct)  is 
N,  and  the  mean  square  of  s(t)  Is  S,  the  normalized  cross- 
correlation  of  the  inputs  is 


I + CS/N)ln  > 


where  ( S/N) i is  the  mean-square  signal- to-n'oise  ratio  at 
either  input.  In  this  case,  the  average  output  is 


FTtT 


o 


*n(S/H)ln>  (S/H)in«l.  (5.2) 


If  one  input  signal  is  [n^(t)  and  s(t)],  as  defined  above, 
and  the  other  is  simply  s(t),  the  normalized  cross-correlation 
of  the  input  functions  is 


(S/N) 


in 


i + (s/nT 


in 


and  the  average  output  is 


FTtT 


2 a-f  , 


(S/N), 


TT 


Is, 


1 + (S/N) 


in 


;S/’N) 


In 


« 1. 


(5.3) 


The  determination  of  the  mean- square  output  noise  (after 
averaging)  has  not  been  attempted  for  the  general  case.  How- 
ever, for  small  Input  signal- to-nolse  ratios,  it  is  logical 
to  assume  that  the  output  noise  is  practically  the  same  as  that 
when  the  signal  is  completely  absent,  which  can  be  evaluated 
when  the  inputs  are  incoherent  gaussian  noises „ This  is 
probably  the  greatest  output  noise,  since,  for  an  infinite 
input  signal- to-nolse  ratio,  the  output  noise  vanishes . We  can 
consider  the  polarity  coincidence  correlator  as  a multiplier- 
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averager  in  which  the  inputs  are  severely  clipped  to  an  ampli- 
tude of  +1  before  xnultiplication0  Van  Vleck  has  shown  that 
the  autocorrelation  function  of  such  strongly  clipped  gaus- 
sian  noise  is 

R(zr')  » ~ sin~1p(«‘) , 

where  p(^)  is  the  normalized  (p(0)  * 1)  autocorrelation  func- 
tion of  the  noise  before  clipping.'1'  When  both  inputs  to  the 
polarity  coincidence  correlator  are  uncorrelated  but  have  the 
sane  autocorrelation  function,  p(P0,  the  mean-square  output 
of  the  averaging  filter  will  be 


y2(t)  > 


w(f)R 2g>  dj , 


where  w(*5)  is  the  transformed  weighting  function  of  the  filter. 
If  we  assume  that  the  noises  have  the  same  spectrum  as  a narrow- 
band  tuned-circuit  filter, 

p(r)  * e coaw0c, 


where  ajy/2rr  is  the  ha  If -bandwidth  and  oj0/2tt  is  the  center 
frequency.  The  mean-square  noise  output  is  then 


oo 


P2(t) 


2 f w(5)  -h  rsin"'1( 


rr 


e cosa)  ^)]  dfo 


Now,  for  an  RC  filter,  w(5) 


JL 

2RC 


- !J|/RC 


e 


and  we  assume 


that  so,  where  the  rest  of  the  integrand  is  appreciably 

different  from  zero,  w($)  » w(0) 


2RC  ‘ 


We  have  then 


P^(t)  - 


tt2RC 


7 


1 -n  "S  o 

Csin“i(e  r cosw^)]2  d'f, 


Now  sin‘  mlx  * x + x3/6  + 3x^/40  + 5x'7/112  + 


o o o © 


so 


[sin~xx]’“=  + 


4^6  + fc8 


■X  + 


O o o o 
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P2(t)  - 


17%  0 


oo 
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! "2fj 

I e cos 


+ 1/3 


^P^  4 v- 

cos  oj  *, 


+ "i3l*  e 

4 


-&>»?  a - -art,?  a 

cos0  o>03  + ^ e F cos  o>0|  +.. 


df . 


J 

Iso  assume  {£p«  a>0,  we  can  replace  the  cosn  ^ ^ by 


Since  we  aisu  assuac  wp 
their  average  values 


Using 


cosnrf 


X 


2 ’ 


* 0,  n odd. 


n even, 


-i. 

nop  ♦ 


.we  find  that  the  mean-square  noise  is  approximately 


r2(t) 


lyJL^luuL 
TT  2RC  0)  y 


(5.4) 


Por  small  input  signal-to-noise  ratios,  then,  the  output  mean- 
square  signal- to-noise  ratio  is  (from  Eq,  (5*2)) 

<s/N)out  * ids?  * «c»,<s/«i»  ■ <5.5) 

By  reference  to  Table  2,1,  we  find  that  for  a multiplier-averager 
with  inputs  [s(t)  + n^(t)3  and  Ls(t)  4 n2(t)]  having  the  same 
statistical  properties  as  in  the  above  example,  the  mean- 
square  output  signal-to-noise  ratio  for  small  input  signals  is 

4RCU)p(S/N)|n  , 

The  polarity  coincidence  correlator  then  has  a disadvantage  for 
the  above  spectrum  of  a factor  1,164  in  small-signal-mean-square 
output  signal- to-noise  ratio,  or  0,7  dbB  The  0,7  db  might  be 
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considered  the  penalty  one  pays  for  not  making  use  of  the  informa- 
tion contained  in  the  clipped  portions  of  the  input  voltage  wave- 
forms o 

If  one  input  is  pure  signal,  and  if  the  signal-to-noise 
ratio  at  the  other  input  is  very  small,  we  can  assume  that  the 
output  noise  is  the  same  as  above  (Eq„  (5.4)),  The  mean-square 
output  signal- to-noise  ratio  for  this  arrangement  is  then  (from 
Eq,  (5»3)) 

<S/!,W  irfe  • 4H<VS/N)ln.  '5,6) 

From  Table  2,1  it  can  be  seen  that  the  small- signal  output  signal- 
to-noise  ratio  of  a multiplier-averager  used  in  exactly  the  same 
way  is 

4RC  topCS/N)^, 

so  the  polarity  coincidence  correlator  again  has  a disadvantage 
of  0,7  db,  for  this  particular  input  spectrum  and  averager. 

The  polarity  coincidence  correlator  is  almost,  but  not 
quite,  a normalized  correlator 5 that  is,  a correlator  which 
determines  the  quantity 


which  is  a normalized  correlation  function..  The  average  output 
of  such  a correlator  would  be  a straight  diagonal  line  on  the 
graph  of  Fig,  5°1*  The  polarity  coincidence  correlator  does 
measure  the  cross-correlation  of  the  clipped  input  signals. 

This  means  that  the  autocorrelation  function  of  a sine  wave,  as 
measured  by  the  polarity  coincidence  correlator,  will  be  saw- 
toothed rather  than  cosinusoidal,  and  all  correlation  functions 
measured  by  it  (except  those  of  already  strongly  clipped  waves) 
will  be  more  or  less  distorted.  As  an  example,  the  normalized 
correlation  function  of  gaussian  noise  which  has  been  passed 
through  a single  tuned-circuit  filter  is  plotted  at  the  top 
in  Fig,  5° 2 and  the  autocorrelation  function  of  the  same  noise, 
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as  it  would  be  measured  by  the  polarity  coincidence  correlator 
is  shown  at  the  bottom.  If  sufficiently  'large  incoherent 
noises  were  added  to  each  input  so  that  the  input  normalized 
cross-correlation  did  not  ever  exceed  Go 7,  the  measured  cor- 
relation function  would  be  little  distorted-, 

It  is  possible  that  a polarity  coincidence  correlator 
could  be  built  more  easily  than  a multiplier-averager ; if  so, 
its  performance  with  respect  to  output  signal- to-noise  ratio 
is  not  enough  worse  than  that  of  a true  correlator  to  rule  it 
out  of  consideration,,  It  has  the  advantage  in  a practical 
application  that  the  input  signals  would  not  require  automatic 
gain  control,  as  is  the  case  with  a multiplier -averager,  which 
may  be  easily  overloaded.  The  greatest  difficulty  in  its  con- 
struction will  probably  be  found  in  the  clipping  circuits, 
where  absolute  symmetry  of  clioplng  must  be  maintained,, 

A polarity  coincidence  correlator  consisting  of  two 
clipper-amplifier  circuits  (Fig,  5.3)  and  a coincidence-averager 
circuit  (Fig,  5*4)  has  been  constructed.  Note  in  Fig,  5.3  that 
a potentiometer  is  provided  at  the  output  of  the  clipper  cir- 
cuits to  allow  adjustment  of  the  output  amplitude.  This  was 
necessitated  by  the  fact  that  the  contact  potentials  of  the 
various  type-6AL5  twin  diodes  varied  greatly.,  and  it  was  not 
found  possible,  even  by  selecting  tubes,  to  make  the  output 
amplitudes  from  different  clipper  circuits  match  exactly  with- 
out such  an  adjustment.  Measurements  made  by  the  methods 
described  in  Chapter  III  indicate  that  this  correlator’s  out- 
put signal- to-noise  ratio  for  small  input  signals  is  inferior 
to  that  of  the  multiplier-averager  by  2 db,  when  the  same  in- 
put spectra  ( tuned-circuit , Q = 4)  and  averaging  networks 
(RC  “0,1  sec)  are  used.  Because  of  a possible  error  of  _£lo5  db 
in  the  measurement,  we  can  only  conclude  from  it  that  the  theoret 
ical  predictions  are  roughly  confirmed. 

Linear  Rectifier  Correlator 


It  will  be  seen  that  the  linear  rectifier  correlator  is  of 
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the  same  form  as  a phase-sensitive  detector  or  coherent  detector, 

p 

of 'which  thorough  analyses  have  been  already  made.  We  here  de- 
termine only  the  average  output  of  the  linear  rectifier  correlator 
in  terms  of  the  properties  of  the  input  functions  and  estimate 
the  small-signal  output  signal- to-noise  ratio. 

Figure  5.5  is  a block  diagram  of  a linear  rectifier  corre- 
lator. By  comparison  with  Fig.  it  may  be  seen  that  the 

linear  rectifier  correlator  is  simply  a multiplier-averager  of 
the  quarter-difference-squares  type,  with  the  square-law  recti- 
fiers replaced  by  linear  rectifiers. 

We  assume  that  the  inputs  to  a linear  rectifier  correlator 
are  [s(t-)  4 n^(t)]  and  [sCt-t)  ♦ n2(t)],  where  s(t),  n^(t),  and 
n2(t)  are  independent,  gaussianly  distributed,  random  functions. 

The  sum  of  these  input  signals  is  s(t)  ♦ s(t-£)  4-  n^Ct)  4 n2(t) 

and  the  difference  Is  s(t)  - s{t-tr)  4 n^(t)  - n2(t).  Wow  the 

average  output  of  a full -wave  linear  rectifier,  whose  input,  x, 
is  gaussianly  distributed  and  has  the  mean  square  o'2,  is  (Eq.  (4.2)) 


We  cannot  simply  determine  the  mean-square  amolitudes  of  the  sum 
and  the  difference  of  the  input  signals  by  adding  the  mean  squares 
of  the  four  individual  components,  because  s(t)  and  are 

not  independent  functions.  We  note  that 


[s(t)  + S(t-t0]2  = s2(t)  4 2s(t)s(  t-fO  4 S2(t--r) 

- 2R(0)  4 2W(r), 

where  R(£)  is  the  autocorrelation  function  of  s(t).  The  mean 
square  of  the  sum  of  the  input  signals  is  then 

C s ( t)  4 s(t~tO  + nx(t)  4 n2(t)]2  = 2CR(0)  4 R(r)  4 N] 

and  the  mean-square  of  the  difference  is 

ls(t)  - s(t-W)  4 nx(t)  - n2(t)]2  = 2[R( 0)  - R(W)  4 N] 


<2 


TM2 7 -67- 

where  W = n^(t)  * n|(t),  the  mean  square  of'  the  background  noises. 
The  average  output  of  the  linear  rectifier  correlator  is  the  dif- 
ference of  the  average  outputs  of  the  sum  and  the  difference  rec- 
tifiers, and  is  (from  Eq0  (5°7 5), 

4% 2[R(0)+B(it')+N  - 4%  |/2[R(0)-R(c)+N] 

- jyh(0)+R(«*)+N  - yfe(05-R(r  )+N  ] * 

If  we  set  R(0)  * S,  the  mean  square  of  s(t),  we  can  write  the 
average  output  as 


FTtT  = y|=  [/N+S[l+p(T'5  ] - ✓N+Stl-pCr)] 


(5,8) 


where  p(f)  is  the  normalized  cross-correlation  of  the  inputs,  Rfe 
can  expand  the  above  by  the  binomial  theorem,  and  we  have 


ft!  = /l+(S/N)Cl*p(C) I - Vl-t(S/K[l-p(C)f 


T^rTl  + \ |[l+p(r)]  +...  -l-  \ |a-p(r) 
v Tr  L - 


(S/N)in  « 1 . 


Therefore,  if  there  is  a large  enough  incoherent  noise  back- 
ground, the  average  output  of  the  linear  rectifier  correlator 
will  be.  directly  proportional  to  the  signal  autocorrelation 
function. 


If  N * 0,  corresponding  to  the  use  of  the  linear  rectifier 
correlator  to  measure  a correlation  function,  the  average  output 
will  be  (from  Eq„  (5,8)), 

nt)  = ci/i+pft)  - v4-p(«n « (5,9) 

A graph  of  this  function,  normalized,  is  shown  in  Pig,  5*6, 
Because  of  the  great  similarity  between  Pigs,  5°6  and  it 

may  be  seen  that  the  distortion  of  an  autocorrelation  function 
as  measured  by  the  linear  rectifier  correlator  will  be  nearly 
the  same  as  that  if  it  were  measured  by  a polarity  coincidence 


correlator^  Fig,  may  be  considered  typical  of  the  distortion 
causes  by  either  device. 


Consideration  of  the  circuit  leads,  to  the  conclusion  that 
the  output  » ignai-to-uoise  ratio  of  the  linear  rectifier  corre- 
lator, for  small  input  signal-. to-noise  ratio,  is  as  much  Inferior 
to  inat  of  the  ruttipller-averager  as  the  linear  detector  is 
inferior  to  the  square -law  detector  in  this  respect.  In  Chapter 
IV  the  difference  was  shown  to  be  less  than,  0,2  db  for  two  cT  *V 
ft rant  input  spectra-,  Experimental  measurements  with  a 
rectifier  correlator  constructed  according  to  the  schematic 
disc rum  of  Fig,  5, 7 are  in  agreement  with  this  prediction- 
Tr.e re  is  little  difference,  when  the  input  signal -tp-noise  ratio 
is  small,  between  a wultipliar^avarager  and  a linear  rectifier 
correlator. 


The  linear  rectifier  correlator  is  simple  to  construct 
.htwever,  r.ign,- quality  rum- and *•  d i f f e r ence  transformers  should 
b€t  used" . Unlike  the  vacuum-tube  multiplier-averagers  it  is 

"er.der.t  cf  vacuum-tube  characteristics , and  does  not  require 
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Fig.  5*6.  Average  output  voltage  (normal it ed)  of  a linear  rectifier 
correlator  ae  a function  of  the  normalized.  crosscorrelntlon  of  the 
inputs,  pCt),  For  negative  values  of  p{T)  the  average  output  i»  nega- 
tive; it  is  an  odd  function  of  p('C'). 
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Appendix  I 

EVALUATION  OF  THIRD- ORDER  CORRELATION  FUNCTION 


We  wish  to  evaluate  the  third-order  autocorrelation 
function, 

R(£l ) * <v(t)v(t^])v(t-t|?(t.r  )> 

In-  terms  of  the  ordinary  autocorrelation  function 

H(r)  - <v(  t)v(t-T)  > . 


For  simplicity  of  notation , we  write 

S.{ti,fg,x^5  * v{  t , ) v{ t g ) v ( ) v ( ) > (A1  1) 

where,  of  course,,  t * 


I 


r. 


■4 


and  T3  h ' *4  ’ 

A sample  of  v(t*  in.  an  interval  of  l^nrth  T i :•  rinded  In  s 
Fourier  p*riC3  <,  of-  Ev  * io ) i and  thi  :•  ex  pres -inn  in  rubs  ti- 
tuted  In  Ed*  tAl-.I')  a’;o ve* 

R(VT2’V  - 


+ bjj.5  inu^t-^  3 


Ca^cos^tg 


+ b^slnio^t*,] 


Ca^cosui^t.^ 


+ b^slrw^tj] 


+ b.  a 


in^t 


where  ua^  » 2rrk/T^  Writing  In  different  summation  integers  in 
each  sum  above  allows  us  to  write  the  above  product  of  sums  as 


c 


H 
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a sum  of  products 

R(£'l>I2>r3)  = 

00  00  00  OD 


•70- 


/ 00  CD  OD  u> 

\ 21  22^1  XI[V:°s“ktl  + Vil"lctl]-Uicos"tt2+  bisln“^2J 


3Sl  H n»l 


[a  cos  o>t  4 b sin  w_t, 3*Ca  cos  tot,  4 b stn»  t , 1 / . (A1.2) 

® m3  m ® 3 n n.  4 n n 4 / 


This  now  consists  of  many  terms  of  the  form 


Vi?  ’C08Vl  eosV2  c0*  V3  cos  Va  * 

where  we  have  Interchanged  the  operations  of  adding-  and  averaging 
and  have  made  use  of  the  ergodlc  theorem,. 

For  gausslan  noise*  the  properties  of  the  coefficients  given, 
in  Eqs.  (1,7)  apply  here,  and  we  see  that  <a^a^aman>  * 0 unless 
the  indices  ar>*  at  least  equal  in  pairs  Then  the  only  non  vanish- 
ing terms  are  those  where  at  leant 

(a)  k » t and  m » 

i h)  k » sj  and  i » n* 

or  (c)  k * ft  and  i * m. 

The  terms  for  the  case  k*  >i-*a  * n will  be  discussed  below.  Mak- 
ing the,  substitutions  indicated  above  as  (a),  (b),  and  (e)  , we 
can  write  the  .nonvanishing  terms  in  the  quadruple  sum  as  three 
double  nums? 


COS  03  t, 
ffi  1 

COS  0)  t- 

COS  03  tn 
in  i 


4 b 
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4 b 


n 


+ b_ 


m 


sin  w t Jdi  cos  to  t~ 
mi  a m2 

sin  w t_3*[a  cos  u>  t„ 
n 3 n n A 

sin  oamt1]*[an  cos  (u^t^ 


4 b sin  oi  t-J 
m m2 

4 h sin  w t . 3 
n n 4 

+ b sin  u>„  t„  3 
n n 2 


<? 


ft 
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4 


" [affl  cos  4 

, OO  ,00 

V”  V [a  cos 

iC — X — v *** 


m*l  n=X 


n fV  cos 


n 


U) 

n 3 


b ain  w t ]o[a 
m m3  n 


u>  t,  + b sin  o)  t-, 
ml  m ml 


b sin  <4  t,3'  [a 
n n 3 m. 


cos  to  t,  4 b sin  to  t..] 
n 4 n n 4 

] 0 [a_  cos  <o  t„  + b sin  <o„ t03. 
n n 2 n n 2 

cos  o»  t.  + b„  sin  <omt.]  > 0 
m 4 m 14/ 


Using  the  further  properties  of  the  coefficients  that  < a b > * 0 

2*  2 on, 

for  all  m?  n and  < a^>  * <b^>  , we  can  write  the  above  as 


■ OO. 

00 

z 

z 

<aa>  <*£> 

COS  W„(t-,“t05  cos  u ( t, -t.  ) 
m i 2 n 3 4 

m=l 

n*l 

.00  , 

CD 

r 

i 

■ <V  <sn> 

cos  Wm(  t-^-t  ) cos  wn(t2“t4^ 

m*l 

2 

n^l 

2 

<an> 

cos  co^C  t,  -t4)  coswn(t2-t^) 

m=l 

n=l 

Now  the  terms  in  Eq.  (Al„2)  for  the  case  k »'t*m  - n have  coef~ 
ficients  of  the  form  <a*>  ' In  Bq-  (1-.  2)  we  proved  that,,  for 

the  case  of  gaussian  statistics. 


<ij>  = 3tr4  - 3«  »2, 

so  these  terms  are  included  exactly  in  the  above  three  double  sums 
as  the  cases  where  m * n»  By  comparison  with  Eq..  (109)  we  have 
immediately 

<v(t1)v(t2)v(t^)v(t4»  - R(t1-t2)R(t^-»t4) 


4 RC^-^jRCtg-^) 

4 R(t1~t4)R(t2-t-3) 


(A1.3) 


or 
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:?ri^2’r3}  * R(^1)R(^3“2'2) 

+ R^)R(r3-.r1)  (Al„3) 

+ RC^RC^-^)  q 

This  formula  is  proved  by  Fano  in  a different  way  for  a slightly 

less  general  case..^ 

The  generalization  of  Eq0  (Al03)  to  a third-order  cross- 
correlation function  will  be  stated  here  without  proofs 


?A^1^VB^2^VC^3^VD^ ^ > 


aAB<'tl“t2)RCD(t3*t4) 

+ RAC^ tl"t3^RBD^ t2“t4^ 

+ RAD(tl“VRBC(t2”V 


or 


(A1.4) 


RAB CD^l’^’V  * RAB(fl)RCD^r3*r2^ 
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4 RAC^T,2^RBD^3-7,1^ 
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Appendix  II 

DERIVATIONS  OF  AUTOCORRELATION  FUNCTIONS  OF  NOISE  HAVING 
RECTANGULAR  AND  TUNED-CIRCUIT  SPECTRA 


As  indicated  in  Eq..  (1,10),  the  autocorrelation  function  of 
a random  noise  is  the  cosine  Fourier  transform  of  its  intensity 
spectrum,,  The  integration  is  here  carried  out  for  two  examples  a 

A . Rectangular  Spectrum 

We  assume  that  the  intensity  spectrum  of  a random  function 
has  the  constant  value  W betv/een  the  frequencies  f - Af  and 
f +Af,  and  vanishes  everywhere  else.  The  center  frequency 
Is  thus  f and  the  half -bandwidth  is  Afu  The  corresponding 
autocorrelation  function  is 


R(f)  * W 


f +Af 

n o 


Jfo-Af 


cos  2nfrdf 


= 2Mf  cos  2uf0^ 


(A2.1) 


B Tuned- Circuit  Spectrum 

We  assume  here  that  the  intensity  spectrum  of  the  random 
noise  has  the  same  form  - s the  response  characteristic  of  a 
single-tuned  resonant  circuit.  Noise  having  this  spectrum  may 
be  generated  by  passing  wide-band  noise  through  a single- tuned- 
circuit  filter.  We  shall  first,  examine  the  analytic  expression 
for  the  response  characteristics  of  such  filters  in  order  to 
show  how  our  definitions  apply  to  series  and  parallel  resonant 
circuits  o 

Series  Resonant  Circuit:  We  consider  first  the  series 

resonant  circuit  of  Fig,  A2ol„  The  ratio  of  the  output  voltage 
to  the  input  voltage  is 

-7?  - 


o 


o 

.*—4^  m 


a 


R + 3(wL  - 1/&C7 


The  intensity  response  spectrum 
is  >•  iven  by  the  absolute  value 
the  square  of  the  expressions 
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Fig*  AP*  X Cerle 8 
Resonant  Circuit. 
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R2  + (WL  - l/^C)2 


■f-  introduce  the  two  parameters,  w , the  resonant  frequency,  and 
. - . %m  dmpinf.  constant,  defined  by 


<£  - 


1/LC  and  w_  * R/2L  . 


The  rezv onse  spectrum  may  then  be 
vri tten 


W fw>  * 


.2  2 

(i) 


{.</”  U,.2)2  + AOJ^U)2 


(A2* 2) 


It  is  interesting  to  note  that  the  spectral  response  of  the 
rarsilel  circuit  of  the  eonfig- 
:ratScn  shown-  in  Fig,  A2.2  Is 
*,f  the  same  form*.  It  is  often 
valid  to  assume  that  a constant 
current  is  applied  to  the  paral- 
lel circuit,  when  it  Is  used  as 
a filter  $ the  ratio  of  the  output 
voltage  to  the  constant  input  current 
is 


Fig.  A2.2  Parallel  Resonant 
Circuit  of  One  Type. 


e 1 

T ' I7RT  ” Jou  T l/jwL  * 

We  again  define  the  parameters  u>y  and  this  time  defined  by 


<? 
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to2  = 1/tiC  and  top  * 1/2B'C. 
The  intensity  response  spectrum  is  then 


W(w) 


- *2)2+  ^2to| 


I 


which,  except  for  the  factor  R’  , is  of  the  same  form  as  Eq, 

(12, 2„ ) . (It  must  be  remembered  that  the  response  spectrum 
of  a.  parallel  circuit  having  the  resistance  in  series  with  the 
inductance  Xl  not  of  the  same  formj  this  case,  which  we  shall 
pall  the  parallel  .resonant  case  in  agreement  with  the  literature ,*2 
will  be  discussed  briefly  at  the  end  of  this  appendix.) 


Spectrum  Properties t We  shall  first  examine  some  of  the 
properties  of  the  series-resonant  tuned-circuit  spectrum  of 
Eq,  (.A2*  2} , The  frequency  of  maxi  mum  response  is  found  by  solv 
ing  the  equation 


dllniL. 

d(.,2> 


2_ 


£(o52~ 


4uA)2  - 


t»2[  2(ft>2-«2)  4 4(^i 

4 4 t^to2)2 


- 0. 


The  solution,  is  easily  seen  to  be  to  * w $ the  angular  frequency 
of  maximum  response  is  « regardless  of  the  Q of  the  circuit* 
The  maximum  value  of  W(us)  is  W(«  ) * 1,  Parameters  which  are 
a convenient  measure  of  the  bandwidth  of  the  spectrum  are  the 
two"half-power"  points  obtained  from  Eq  (A7* 2)  when 


or 


f<V 


l&L 


(“h  ■ 


“o>2 


2 2 


1 

2 * 


The  solutions  of  this  equation  are 

to  , «a/o)2 

h y o 


o 

■f  tod 


> i “r 


The  damping  constant  toy  is  equal  to  the  angular  half-bandwidth 
fox  all  values  of  Q,  However,  for-  low-Q  circuits,  the  frequency 
of  maximum  response  is  not  midway  between  the  two  half-power 
points.  The  Q of  a series  circuit  is  defined  as  the  ratio  of 
the  series  reactance  of  either  reactor  at  resonance  to  the 
series  resistance.  For  the  circuit  of  Fig,  A20l, 

Q **  to  L/R  * 14)  RO  » to 

O O O JF 

The  total  angular  frequency  bandwidth  between  the  half-power 
points  is 

2toy  * O)  /Q„ 


Analytical  Properties  of  W_f uj)  ? Factoring  the  denominator 
of  Eq  (A20  2)  , we  can  write  WO)  as  a scan  of  partial  fractions.} 

vn;o)  * 4 4 4 


where  to1 
by 


A = 


__  (A2„3) 

o 

“p  and  the  quantities  A,  B,  C,  and  D are  given 


wp.(o) 5 ~ Ja>y) 

235T*~" 

OOyt^O1-  jCU„) 


■\v,  5 


b = 


D * 


24) 5 


“CO  S ) 


2;P 


The  function  WO)  hasr,  in  general,  four  poles  in  the  complex  plane. 
The  locations  of  these  poles  are  indicated  by  the  denominators  of 
the  fractions  in  Eq  (A2,3)  and  are  plotted  in  Fig,  A2<>3®  It  will 
be  noted  that  for  toy  < o>  the  four  poles  are  symmetrically  lo- 
cated on  the  circle  f 0)  1 = co  _ When  oj_  is  ecrual  to  o>  (Q  * 1/2)  the 
four  simple  poles  merge  into  two  second'  order  poles  at 
As  Wy  is  increased  further  (Q^  1/2)  the  two  second-order  poles 
split  into  four  simple  poles,  all  lying  on  the  imaginary 
axis.  As  toy  increases  from  oo  to  oo,  two  of  these  poles  move 
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TK2  7 

from  the  points  + toward  the  origin,  while  the  other  two 
move  fro®  + toward  + J ca  > 


Fir  A2,  ?,  Co&olex  to-Plan#  Showing  Location  of 
Poles  o?  Function  Wfu>)  . Arrows  Show  Motion  of 
Pc'.es  as  wy  Increases,  Remaining  Fixed,. 

Autocorrelation  • With  the  above  in  formation  we 

are  now  ready  to  evalua te  the  autocorrelation  function  of  noise- 
having  the  intensity  spectrum  of  Eq  (A2*2)  . In.  order  to  ob- 
tain the  normalized  autocorrelation  function  p ( t ) we  shall  simoly 
evaluate  Eq,  (1.10)  and  normalize  the  result  (so  that  p(0)  * 1), 
Since  f„(  <4  is  an  even  function  f,Ea  (A2.2)],  it  is  possible  to 
write 

oo 

R(r)  * | f (A2 ,4.  J 

*co  ° 

We  will  evaluate  the  above  only  for  nt  positive,  since 

H(-0  - R(T),  ( A 2 , 5 ) 

because  R {*)  is  an  autocorrelation  function. 

Case  1$  0 < Wy  < In  this  case  the  integral  of  Eq..  (A2..4) 

is  easily  evaluated,  by  means  of  a contour  integral  along  a path. 
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nantaiflinp.  the  real  axis  and  a large  semicircle  around  the 
npr  &r  half-plane.  Then  for  £>  0, 
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T'.*>refr,rf  the  no:malire4  autocorrelation  £ar*rtion  p (r ) is 
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This  could  also  b*  done  by  contour  int“y.r^tlon,  bu<  w*  find 
that 
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Therefore,  for  Q - 1/2,, 
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Case  III 5 u>o  < oipg  For  very  low~Q  circuits  the  contour 
integral  is'  again  useful*  In  fact,  the  integral  evaluated  for 
Case  I above  may  again  be  used  if  we  note  that  , as  defined 


by 


Is  now  an  imaginary  number.  Defining  a new  parameter, 

»»  * ~ a}2 

W l*3?  o i 

we  find,  without  further  ado. 


p(t)  * 


-V*i 
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[cosh  of  1 - 


sinh  a)"  it|  3 . 

(A2..9) 


Parallel  Resonant  Circuit?  The  correlation  functions  for  the 
medium  and  low-Q  cases  derived  above  correspond  only  to  response 
spectra  of  the  circuits  of  Figs.  A2,l  and  A2«>2,  If,  for  example., 
the  circuit  is  a parallel  resonant 
circuit  of  the  form  shown  in  Fig- 
A2.4,  the  intensity  response 
spectrum  is  of  the  form 
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Wp(  w) 


«*! + 
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-o 


(a£-i^)2-  - 2 2 


(A2„10) 


'+  4o)  c«^ 


7igo  A2„4  Usual  Parallel 
Resonant  Circuit  Configu- 
ration., 


where  u£  * 1/LC  and  = R"/2L,  The  normalized  autocorrelation 
function  of  random  noise  having  the  spectral  intensity  given  by 
Eq.  (A2<,10)  has  been  computed  by  the  same  methods  as  in  the  pre^ 
vious  example.  The  results  are 


p(t)  = 


cos  o>?  T 


<Mq  - <“f> 

((P2  + 40)|) 
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Q > 1/2 1 
(A2.ll) 
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Q < 1/2. 


Wh-n.  ; is  very  large,  £q.  (2  11)  also  reduces  to  E n U2  ?) 

Besponse  curves-  for  the  series  and  parallel  resonant  cir- 
-uits  are  presented  graphically  la  the  literature  A4  Normal- 
ized. correlation  functions  for  noise  having  the  corresponding 
are  plotted  in  Fig.  A2  5 for  various  values  of  Q* 


p(r)  0.5 


r 


^C0nt^  Autocorrelation  function*  for  nol*o  having  "tuned- 
circuit  spectra.  Solid  curve:  Serie*  resonant  circuit;  Daehed  curve 
Parallel  resonant  circuit.  Both  curve*  are  even  functions  of  t.  For 
^2  4,  the  two  curve*  lire  practically  identical 


Fig.  A2.5  (cent.)  Autocorrelation  functions  for  nolae  haring  "tuned- 
clrcult"  spectra.  Solid  curve:  Serlee  resonant  circuit;  Dashed  curve: 


Parallel  resonant  circuit.  Both  curves  are  even  functions  of  z.  For 


Q £ h,  the  tvo  curves  are  practically  identical. 
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Appendix  III  ^ 

CORRELATION  FUNCTIONS  OF  THE  OUTPUT 
OF  A FULL-WAVE,  vTH-LAW  DETECTOR 
by 

DaYld  Middleton  and  Noel  Stone 

The  dynaalc  response  of  a full-wave,  vth-law  nonlinear 
device  say  be  represented  by 

I(t)  - 0 | VCt)  J v - g(V(t))  , (-oo<  / < oo),  (v£  0) 

(A3.1) 

where  I < t ) is  the  Instantaneous  input  disturbance,  correspond- 
ing to  the  input  wave  V(t),  and  I is  an  appropriate  scale  fac- 
tor. As  has  been  shown  elsewhere,^  the  full-wave  relation 
(A3.1)  nay  be  expressed  in  tens  (aore  convenient  for  analyt- 
ical purposes  when  V(t)  consists  of  a signal  and  noise)  of  a 
(coaplex)  Fourier  transform  by 

I(t)  - ^ J f(l5)Ce1^V(t)4e‘l/Y(t))djr,  (A3. 2) 

C 

where  C is  a contour  extending  along  the  real  axis  froa  -a>  to 
♦ m and  Indented  downward  in  an  lnflnlteslaal  sealolrcle  about 
a possible  singularity  at  $ • 0.  Here  f(l£)  is  the  (coaplex) 
Fourier  transform  of  the  dynaalc  characteristic  g(v),  which  is 
calculated  in  this  Instance  froa 

f(i$)  - J g(V)e"1VfdV  , Ia($)  <0. 

^0 

Specifically,  one  readily  finds  here  that  for  (A3.I), 

f(l^)  -PR' ■+1)(1J)"V"1  . 
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The  autocorrelation  function  of  I(t)  is 


46 


Rj(t)  *<7(t-^)I(t2)^>  state  av.  = -h 

^ C C 


(A3o5) 


where  the  statistical  average  is  taken  over  the  random  por- 
tions of  the  input  ( V( t ) ) and  the  time-average  over  the 
phases  of  the  signal,  if  it  is  periodic-.  If  it  is  not,  as 
is  frequently  the  case  here,  when  the  signal  portion  of  ?(t) 
is  itself  a noise  wave,  this  time  average  is  replaced  in  the 
usual  manner  by  an  additional  statistical  average,  it  being 
assumed  here  that  there  is  no  correlation  between  signal  and 
noise,  in  any  case.  Equation  (A3. 5)  may  be  somewhat  simplified, 
to 


Bi(t)  If 


fd51)f(iJ2)tr2(j1,?2-,t)T 


2"  6 c 


(A3. 6) 


in  which  P2  is  the  characteristic  function  (i,e.  , the  Pourier 
transform  of  the  probability  density  W2(V^,V2$t)  of  the  input 
wave  V(t) . [Por  the  V(t)  assumed  here,  the  following  symmetry 
properties  of  P2  are  easily  established? 


■ ^2^1 » $ 2*^V  ’ 


(A3. 7) 


stationary  ergodic  ensembles  are  also  assumed  throughout.] 

Let  us  now  determine  Rj(t)  for  a variety  of  input  waves 
V(t).  We  summarize  below  some  of  the  principal  results? 

I.  V(t)  = noise  alone? 

Por  normal  random  noise  the  characteristic  function  P2 
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associated  with  the  second-order  probability  density  W2(V^,V2|t) 
iSl6 


(A3. 8) 


where  ijr(t)  = tp(t)  is  the  autocorrelation  function  of  the  input  . 
noise  V( t) . p(t)  is  the  normalized  correlation  function^  and 


t = V£ 


(It  is  assumed  that<V>  * 0.)  From  (A3.6)  we  get 


Rrct)  . f f (ij1)-v-3-Ci/2)-v-1 

n c c 

_ i(J2+|2) 

• cos  ht+pftjjjfgje  2 12 


» 4 


t^pCt)2”  h2 
(2n)i  ho, 


2n 


(A3. 9) 


where  the  amplitude  functions  li  0v,  are 

o,  2n 

>*o,2n  ■ 1~V'1|rTt<,U  jf  e'^2/2  J2n_V'1<l?,  (A3.10) 

- (-l)n«-v,e>n2n+  , 

in  which  (a)n  = a(a+l)  - (a+n-l);j  (a)Q  - 1*  The  final  result  is 

2 

Bj(t)  - <2*)V  ^n^)2  2F1<“  v/2^“  v/2:l/25p2(t)) 


A7 


(2*3  v B2  r^/vil3  2 


r<^) 


(-v^pCt;211 

' n J ( i/2)_ 


and  (l/2)n  = (2n)  1/  22nn  l 


II.  V(t)  = sum  of  two  statistically  independent  noise.-Wavess 

For  the  problem  considered  in  Chapter  TV  of  this  report,  we 
wish  to  determine  the  autocorrelation  function  of  our  law, 
full-wave  rectifier  when  the  input  V(t)  « + Vjj  , i.e<>,  is 

the  sum  of  two,  uncorrelated  noise  voltages.1  The  Characteristic 


the  two 
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function  ?2  in  (A3 .6)  now  factors  into  the  product  of 

characteristic  functions  of  Vw  and  Vw  vis* 

"1  n2» 

F2(^l’^2^t)V  " F2(^l*^2^t)N1  • *2^1**2^112 

2 


(A3. 12) 


• t^2p2^ ^ 1^2  » 
w 

this  last  for  normal  random  noise  such  that  <T^  > * <Y|j>«  0. 
As  before,  [cf . (A3.8) , <VR  2>®  <Vj|2>  *2*  etc*2 

tin*  1 2 

♦p 

om^s  pC>0)  (A3. 13) 

?1 


be  tha  input  "signal"- to-nolse  ratio  (?B  represents  a "noise" 
signal),  and  following  the  procedure  of  ?A3.9),  we  can  write  here 


Bj(t)  • 4 


t2” 

7feT.t?1(t)+,p2(t))J“h|)2n, 


(A3. 14) 


where  now  hQ  ^ is  given  by  (A3, 10)  if  t * 1^+  t2  ■ t^(l*p). 

For  identical  spectral  ahanea  (but  different  total  intensities) 
the  general  expression  (A3* 14)  simplifies  somewhat  to 

B:(t)  * » £ «? 

r-*o 


- [2t1(l^>))V 


( “v/2)n  p(  t)^n 
n!  (l/l2>n 

(A3. 1 fib) 


since  p^(t)  * p2(t)  * p(t)  under  this  assumption.  In  the  case 
of  weak  signals,  i.e. , p2«  1,  this  reduces  still  further  to 


p"  «1 


(A3  *16*  > 


?V.' 


-By- 


RjCt) 


ca^d+p)]  j^n^) 


t"v/g^n^irt)  2n 

^-nTTfrST 


'n 


• £ita*jU+p)]T '(ijl)2  2f1<-»/2,-*/2»  V2iF(ti2) 

(*’.161,. 

Similar  techniques  nay  be  used  for  other  types  of  atonal**  for 
'©tails  see  Refs.  A 5 and  A6.  Note  here  that  we  have  obtained  a 
cornet  and  general  result,  pood  for  all  values  of  o.  These 
results  nay  now  be  Inserted  directly  into  Eq.  (4*4)  and  the  out- 
rut  signal-to-nolse  ratios  computed,  as  indicated  [Eqs.  (4.11) 
e t seq(]  for  the  various  types  of  smoothing  filters  and  corre- 
lation "“unctions  P(t)  considered  in  this  report. 
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